THE  SECOND  ANNUAL  AWARD  FOR 


EXCELLENCE 
AN  ANALYSIS 


JAMES  HENRY  CAPPS 


^^POSTGRADUATE  SCHDOD 

naval  ?0biyrr:v   93940 

MONTEREY,    CALIF.   9W 


United    States 
lava!   Postgraduate  School 


JIOMTEKM.    CALIF.   93*M 


rHE  SIS 


THE  SECOND  ANNUAL  AWARD 

FOR  EXCELLENCE  IN  TEACHING 

AN 

ANALYSIS  OF  PROCEDURE  AND  DATA 

BY 

James  Henry  Capps 

Thesis  Advisor: 

R. 

R. 

Read 

September  1971 


App.wv&d  ^on.  public  tizlzcLid)   dLitsiibuutLon  uiilunitzd. 


The  Second  Annual  Award  for  Excellence  in  Teaching 
an  Analysis  of  Procedure  and  Data 


by 


James  Henry  Capps 

Captain,  United  States  Army 

B.S.,  North  Georgia  College,  1966 


Submitted  in  partial  fulfillment  of  the 
requirements  for  the  degree  of 


MASTER  OF  SCIENCE  IN  OPERATIONS  RESEARCH 


from  the 


NAVAL  POSTGRADUATE  SCHOOL 
September  1971 


ABSTRACT 

The  procedure  and  data  of  the  Second  Annual  Award  for  Excellence  in  Teaching 
are  discussed  and  studied.  Basic  statistics  of  balloting  are  presented  and  increased  partici- 
pation is  noted.  The  techniques  of  data  reduction  are  described.  Some  special  studies  are 
made  concerning  (i)  score  data  has  distribution  of  mixed  exponential  type  (ii)  the  effect 
on  the  score  of  whether  or  not  an  instructor  teaches  during  the  quarter  of  the  balloting 
(iii)  concordance  determination  with  last  year's  ranking  of  instructors.  Recommendations 
for  modifying  future  procedural  items  are  made. 
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I.  INTRODUCTION 

The  Superintendent  of  the  U.  S.  Naval  Postgraduate  School,  Rear  Admiral 
Robert  W.  McNitt,  USN,  directed  in  May  of  1969,  that  an  award  be  established  to 
recognize  excellence  in  teaching.    To  comply  with  his  directives  a  committee  was 
formed  from  among  the  faculty.    The  objective  of  this  committee  was  to  select  a 
recipient  each  year  for  the  Outstanding  Teaching  Award  to  be  given  during  the  June 

graduation. 

This  committee  was  to  be  composed  of  a  Chairman,  a  secretary  and  five  members. 
These  seven  people  were  to  be  chosen  to  provide  a  wide  variety  of  backgrounds  and 
curricula.    Each  year  four  persons  would  leave  the  committee  and  be  replaced  by  four 
new  members.    Thus,  new  ideas  and  concepts  would  be  engendered  in  the  selection 
process  while  retaining  a  core  of  persons  familiar  with  the  existing  system. 

The  members  of  this  year's  committee  were  Professors  Kovach  (Chairman), 
Hoisington  (Vice-Chairman  and  Secretary),  Musgrave,  Nunn,  Renard,  Read  and  Schultz. 
The  committee  decided  to  retain  from  last  year's  committee  the  same  philosophical 
outlook  concerning  the  nature  of  excellence  in  teaching  along  with  how  it  should  be 
reliably  identified  and  evaluated.    The  interested  reader  will  find  this  outlook  in 
Robert  William  Geary's  Thesis,  The  First  Annual  Award  for  Excellence  in  Teaching, 
A  Study  of  Procedure  and  Analysis  of  Data,  June  1970.    However,  to  set  the  ground- 
work for  this  paper  certain  guidelines  for  the  selection  process  will  be  discussed.  These 

guidelines  are  as  follows: 

1.      All  faculty  with  the  exception  of  the  Department  Chairmen  and  the  members 
of  the  selection  committee  are  eligible  to  receive  the  award. 

2       The  voting  population  includes  all  current  students,  faculty,  Curricular 
Officers  and  Assistant  Curricular  Officers.    Also  included  this  year  is  the 
group  of  Naval  Officers  which  graduated  in  1969. 

3.      Participation  in  the  poll  is  entirely  voluntary  and  no  one  is  required  to 
sign  his  ballot. 


4.  Care  and  discretion  are  to  be  used  to  ensure  that  no  ranking  of  candidates 
is  published. 

5.  For  the  ballot  to  be  valid  the  voter  must  indicate  himself  to  be  reasonably 
well  acquainted  with  at  least  five  members  of  the  candidate  list. 

6.  The  voting  population  is  cautioned  not  to  vote  on  the  basis  of  personality 
or  popularity  but  on  teaching  ability  and  performance. 

In  order  to  maintain  total  objectivity  among  the  selection  committee  it  was 

determined  that  an  individual  from  outside  the  faculty  would  handle  the  ballots, 

collate  the  data  and  submit  the  results  to  the  selection  committee.    Only  after  the 

recipient  of  the  award  had  been  selected,  would  the  winner's  name  be  made  known 

to  the  selection  committee. 


II.  THE  BALLOT 


A.      FORMAT 

An  instruction  sheet  was  attached  to  the  front  of  the  ballot  to  explain  the  purpose 
of  the  award,  give  instructions  on  how  to  fill  out  the  ballot,  and  explain  the  require- 
ments for  validating  the  ballot.    Results  indicate  that  greater  care  should  be  exercised 
in  preparing  the  cover  sheet,  particularly  in  the  area  of  ballot  validity.    This  is  covered 
in  greater  length  later  in  this  section. 

The  ballot  itself  was  composed  of  four  parts.    Part  A  was  a  statistical  gathering 
aid  to  help  in  an  analysis  of  the  voting  population  characteristics.    The  voter  was 
asked  to  identify  his  voter  category,  rank,  Branch  of  Service,  and  Curricular  area  if 
military;  if  civilian  his  academic  rank  and  department  were  to  be  circled. 

Part  B  included  three  blanks  to  be  used  in  indicating  first,  second,  and  third 
choices  for  the  award  using  the  four  digit  identification  number  in  Part  C. 

Part  C  of  the  ballot  identified  the  candidates  for  the  voter.    Each  eligible  faculty 
member  was  listed  in  alphabetical  order  under  the  heading  of  his  department.    A  four 
digit  identification  number  preceded  each  candidate.    The  voter  was  asked  to  circle 
this  identification  number  of  all  those  faculty  members  with  whom  he  considered 
himself  to  be  reasonably  well  acquainted  in  an  academic  capacity. 

The  last  portion  of  the  ballot,  Part  D,  was  to  be  used  to  comment  on  the  reasons 
for  his  selection.    This  portion  was  not  mandatory,  but  was  considered  beneficial  in 
the  final  selection  processes. 

The  major  variations  in  this  year's  ballot  from  the  year  before  were  as  follows: 

1       The  second  portion  of  the  ballot  (the  blanks)  was  added  to  provide  a 
faster  and  safer  means  of  extracting  the  nominations  from  the  ballot. 

2.      The  blanks  were  removed  from  the  left  side  of  the  four-digit  identification 
number. 


The  only  changes  recommended  for  the  actual  ballot  for  next  year  would  be  to 
include  another  blank  in  Part  B  that  can  be  marked  with  a  "1"  if  a  comment  is  made 
in  Part  D  and  to  assign  each  teacher  a  permanent  four  digit  identification  number  for 
Part  C  instead  of  renumbering  each  year.    This  would  further  facilitate  data  retrieval. 
Included  as  Annex  A  of  this  document  is  a  FY  '71  ballot. 

B.      THE  BALLOTING  PROCESS 

The  method  whereby  the  ballots  were  distributed  and  returned  merits  attention, 
for  the  selection  process  is  only  as  good  as  the  response  of  the  voters. 

Last  year  the  ballots  were  distributed  through  the  Curricular  Officers  and  Section 
Leaders.    In  an  attempt  to  increase  student  participation  the  selection  committee 
decided  a  new  method  should  be  found  for  distributing  and  returning  the  ballots. 
The  ballots  were  distributed  utilizing  the  Student  Mail  Center  (SMC)  this  year.    The 
completed  ballot  was  placed  in  an  envelope  addressed  to  the  Superintendent  of  the 
Naval  Postgraduate  School  and  deposited  in  a  marked  box  outside  the  SMC.    The 
envelopes  were  coded  55  BAL  to  help  route  them  to  the  person  assembling  the  data. 

The  Alumni  selected  to  participate  were  the  Naval  Officers  who  graduated  in 
calendar  year  '69.    Their  names  and  addresses  were  taken  from  a  data  tape  maintained 
in  the  computer  facility  after  the  addresses  had  been  updated  [ref.  4] .    The  completed 
ballots  were  returned  to  the  mailing  address  previously  mentioned. 

C.      BALLOT  VALIDATION 

1.      Assembling  the  Data 

Once  the  completed  ballots  had  been  returned  to  a  central  location,  the 
validation  process  for  each  ballot  began.    The  ballots  were  removed  from  their  envelopes 
and  cover  sheets  were  discarded. 

The  validation  process  encompassed  counting  to  ensure  that  Part  C  of  the 
ballot  had  at  least  five  identification  numbers  circled  and  that  Part  B  did  not  !  ave 
any  write-in  nominations.    If  less  than  five  identification  numbers  were  circled  in 
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Part  C  or  if  the  only  nominations  were  write-ins,  the  ballot  was  considered  void  and 
placed  in  a  separate  stack.    Valid  ballots  were  numbered  so  that  specific  data  could 
be  retrieved  at  a  later  date  if  necessary. 

The  chief  cause  of  void  ballots  was  the  restriction  that  at  least  five  persons 
be  known  by  the  voter.    Of  the  281  void  ballots,  265  were  deemed  void  for  this 

reason. 

Another  fifteen  ballots  or  5.7%  of  all  void  ballots  were  deemed  void 
because  write-in  nominations  of  ineligible  faculty  had  been  made  in  place  of  numbers 

from  the  eligible  faculty. 

One  reason  for  the  high  number  of  void  ballots,  281  out  of  1722,  could  be 
attributed  in  part  to  the  influx  of  first  quarter  students.    Each  person  receiving  a 
ballot  was  requested  to  return  the  ballot  whether  or  not  he  knew  five  eligible  faculty 
members.    Yet,  the  number  of  void  ballots  is  too  great  to  be  the  result  of  first  quarter 

_,        „         .,           .^„i..j^  tuof  o  iqrrro  rmrphpr  of  nersons  misinter- 
students  alone,    mereioie,  it  vvab  concmaea  c^ax  ~  ijie~  i 

preted  the  instructions. 

2.      Transfering  the  Data  to  Tape 

When  the  above  validation  process  was  completed,  the  ballots  were  given 
to  key  punch  operators  to  transfer  the  data  to  IBM  cards.    The  IBM  cards  were  used 
as  data  for  a  COBOL  routine  to  check  for  key  punch  errors  and  transfer  virtually 

error  free  data  to  a  magnetic  tape. 

An  explanation  of  how  the  COBOL  routine  checked  for  key  punch  errors 
will  also  clarify  why  the  identification  numbers  were  used.    The  four  digits  comprising 
the  teacher  identification  number  were  arranged  so  that  the  first  three  digits  identified 
the  particular  teacher.    The  first  teacher  on  the  ballot  had  an  identification  number 
101.    One  was  added  to  this  number  to  form  the  identification  number  for  the  second 
teacher,  102.    The  process  was  repeated  until  the  last  identification  number  was  formed. 
The  first  three  numbers  formed  a  vector,  N,  which  when  multiplied  by  a  fixed 
weighting  vec'or,  S ,  formed  an  inner  product.    The  last  digit  of  this  inner  product 
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formed  the  fourth  digit  of  the  identification  number.    As  an  example  teacher  299  would 
yield 

/3 

(299)     5  I  =  6  +  45  +  9  «  60, 

Thus,  his  full  number  would  be  2990. 

The  above  described  procedure  proved  very  useful  for  only  correct  identifi- 
cation numbers  were  transferred  from  the  ballot  to  the  tape.    An  error  in  key  punching 
would  cause  an  error  message  giving  the  ballot  number  and  its  cause  for  rejection. 
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III.  STATISTICAL  ANALYSES 

A.     POPULATION  CHARACTERISTICS 

One  of  the  most  important  factors  of  the  voting  was  the  voter  response.    After 
sorting  the  valid  from  void  ballots  the  percentages  of  response  were  determined  for 
each  voter  cagegory.    Table  I  below  lists  findings  from  the  breakdown  of  the  ballots. 

Table  I.    BALLOT  BREAKDOWN 


No.  Eligible 

No.  Valid 

%  Valid 

%  Increase  Over 

Voter  Category 

Voters 

Ballots 

From  Eligible 

Previous  Year 

Student 

1890 

1023 

54.1 

5.1 

Alumni 

525 

246 

46.9 

7.9 

Faculty 

314 

107 

34.1 

8.5 

Curricular  Officer 

16 

5 

31.3 

(1.7) 

Unknown* 

— 

60 

*  Includes 

40  ballots  in  whic 

h  Part  A  was  omitted 

()  indicates  nega 

live  number 

. 

The  last  column  of  Table  I  presents  the  percentage  change  over  the  last  year,  indicating 
that  all  valid  voter  categories,  except  that  of  the  Curricular  Officers1,  improved. 
The  number  of  eligible  voters  in  both  the  student  and  faculty  categories  increased 
appreciably;  therefore,  the  percentage  increases  shown  indicate  a  significant  increase 

in  response. 

This  year  before  mailing  the  alumni  ballots,  the  address  tape  maintained  by 
the  computer  center  was  updated.    Even  though  five  less  ballots  were  mailed  the 
increase  in  response  was  7.9  percent.    This  supports  the  belief  that  updating  of 
the  tapes  would  improve  alumni  response. 

The  large  number  of  ballots  with  no  voter  category  indicated  this  to  be  a 
definite  problem  area.    Two  possible  causes  are  listed  on  the  following  page: 


1  Curricular  Officers  who  identified  themselves  as  alumni  had  their  ballots  included 
in  the  alumni  group. 
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1.  The  instructions  concerning  the  voter  category  were  vague  and  misinter- 
preted. 

2.  The  voter  did  not  want  to  take  the  time  to  fill  out  Part  A. 

3.  The  voter  did  not  want  to  be  identified. 

Of  the  above  the  most  likely  explanation  concerns  the  instruction  sheet.    The  reference 
to  Part  A  was  given  under  Step  O.    This  may  have  led  the  voter  to  assume  that  no 
importance  was  placed  on  this  information.    However,  in  order  to  improve  the 
balloting  procedure,  information  concerning  the  voters  is  necessary.    The  format  of 
Part  A  should  be  changed  to  place  the  voter  category  under  the  heading  of  VOTER 
CATEGORY  instead  of  beside  the  heading  in  hopes  that  the  voters'  attention  will  be 

called  to  the  choices. 

The  1441  valid  ballots  consisted  of  71  percent  students,  17.1  percent  alumni, 
7.4  percent  faculty,  0.3  percent  Curricular  Officers  and  4.2  percent  unknown.    The 
420  ballot  increase  over  last  year  reflects  both  an  increase  in  voter  population  and 
improved  participation  in  the  voting. 

B.      CLOSER  OBSERVATIONS 

After  studying  the  voter  categories  it  was  determined  to  research  the  military 
and  faculty  data  for  further  information  concerning  the  voter  population.    Table  II 
presents  a  breakdown  of  faculty  voters  by  curricular  department  and  academic  rank. 
The  columns  indicate  the  different  ranks  and  rows  indicate  academic  department. 
By  scanning  the  jth  column  and  ith  row,  a  determination  of  the  number  of  valid 
ballots  from  faculty  of  i  department  and  of  j  rank  can  be  made. 

Tables  III,  IV  and  V  breakdown  the  military  voters  by  Branch  of  Service,  Rank 
and  Voter  Category  respectively  in  each  curricular  area.    The  ith  row  gives  the 
curricular  area  and  the  jth  column  gives  Branch  of  Service,  Rank,  or  Voter  Category 
according  to  the  title  of  the  table.    The  "faculty"  column  in  Table  V,  Voter  Category, 
contains  those  ballots  marked  faculty  and  military.    One  possible  explanation  for  a 
person  being  listed  as  military  and  a  member  of  the  faculty  would  be  that  the  voter 
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Table  II.    FACULTY 


Rank 


Department 


Aeronautics 


Aviation 
Safety 


Business  Administra- 
tion &  Economics 


Electronics 
Engineering 

Government 
&  Humanities 


Material  Science 
&  Chemistry 


Math 


Mechanical 
Engineering 


Meteorology 


Oceanography 


Operations 
Analysis 


Physics 


Navy  Management 
Systems  Center 


c 

<-3 


<    Q- 


2 

2 


%  ° 

TO  i/l 

O  <4- 

<  Du 


-a 

21 


13 


16 


11 


»_  -a 

E  2 

3  c 

Z  LLl 


12 


13 


22 


31 


11 


13 


40 


15 


15 


15 


46 


35 


21 


15 


Table  III.    BRANCH  OF  SERVICE 


CURRICULAR 
AREA 

NAVY 

ARMY     MARINE 

COAST 
GUARD 

AIR 

*         FOREIGN 
FORCE 

No  Curriculum  Noted 

16 

1 

1 



30 

Operations 

Analvsis 

123 

26 

18 

1 

7 

31 

Aeronautical 
Engineering 

68 

1 

1 

32 

Electronics  & 
Communication 

119 

1 

1 

10 

33 

Ordnance 

66 

7 

2 

I — I 

1 

I 

3 

- 

34 
Naval 
Engineering 

52 

2 

35 

Environmental 
Science 

110 

2 

36 

Management  & 
Computer  Science 

230 

9 

16 

3 

37 

Engineering 
Science 

35 

1 

1 

38 

Baccalaureate 

134 

___ 

39 

Defense 

7 

1 

4 

Management 
TOTALS 

960 

34 

32 

19 

2 

i 

33 

' 
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Table  IV.  RANK 


CURRICULAR 
AREA 


No  Curriculum  Noted 


30 


Operations 
Analysis 


31 


Aeronautical 
Engineering 


32 


Electronics  & 
Communication 


33 


Ordnance 


34 


Naval 
Engineering 


35 


Environmental 
Science 


36 


Management  & 
Computer  Science 


37 


Engineering 
Science 


38 


Baccalaureate 


39 


Defense 

Management 


TOTALS 


01 


02 


29 


14 


30 


13 


20 


10 


10 


68 


12 


32 


224 


62 


03 


10 


88 


40 


69 


33 


31 


51 


64 


04 


63 


21 


41 


_4- 


20 


39 


26 


11 


39 


86 


10 


53 


05 


06 


445 


358 


62 


37 


128 


23 
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Table  V.    VOTER  CATEGORY 


CURRICULAR 
AREA 

No 
Voter 
Category 

STUDENTS 

Faculty 

Alumni 

Curricular 
Officers 

Enroll- 
ment 

Votes 

Per- 
centage 

No  Curriculum  Noted 

19 

1 

5 

30 

Operations 
Analysis 

291 

182 

62.5 

1 

24 

31 

Aeronautical 
Engineering 

209 

62 

56.9 

21 

32 

Electronics  & 
Communication 

238 

134 

56.3 

20 

33 

Ordnance 

94 

70  I      74.5 

1 

21 

I 

34 
Naval 
Engineering 

90 

48 

53.3 

17 

1 

35 

Environmental 
Science 

170 

97 

57.0 

3 

24 

2 

36 

Management  & 
Computer  Science 

2 

390 

227 

58.2 

3 

77 

2 

37 

Engineering 
Science 

115 

37 

32.2 

5 

38 

Baccalaureate 

307 

132 

42.9 

1 

32 

39 

Defense 
Management 

1 

86 

15 

17.4 

TOTALS 

3 

1890 

1023 

I 
I 

54.1 

10 

246 

5 

18 


was  one  of  the  school's  Navy  Instructor  personnel.    Another  possible  explanation 
would  be  an  error  in  completing  Part  A  of  the  ballot.    However,  the  first  explanation 
was  deemed  to  be  the  more  probable  of  the  two.    Figure  1,  Recommended  Part  A, 
is  a  possible  solution  to  some  of  the  previously  mentioned  problems  in  this  area. 


Voter  Category 

S  Student 

F  Faculty 

A  Alumnus 

C  Curricular  Officer 


Students,  Alumni,  Curricular  Officers 

Rank     Branch  of  Service      Curricular  Area 


01 
02 
03 
04 
05 
06 
07 


N 
M 
A 
C 
L 
F 


Navy  30     Ops  Analysis 

Marine  Corps     31      Aero  Engr 


Faculty 

Rank  Department 

IR      Instructor      AE    Aeronautics 
AT    Asst  Prof       AO    Aviation  Safety 


Army  32      Elec  &  Comm  Engr  AC    Assoc  Prof     MN  Bus  Ad  &  Econ 

Coast  Guard      33     Ordnance  PR     Professor       EE  Elec  Engr 

Air  Force  34      Naval  Engr  GH  Govt  & 

Foreign  35      Envir  Sci  Humanities 

36  Mange  &.  Comptr  Sci  MC  Mat  Sc  &  Chem 

37  EngSci  MA  Math 

38  Baccalaureate  ME  Mcch  Engr 

39  Def  Management  MR  Meteorology 

OC  Oceanography 

OA  Ops  Analysis 

PH  Physics 

NS  Navy  Mgt  Sys 
Center 

Figure  1.    RECOMMENDED  PART  A 


C.      DISTRIBUTION  OF  Mj 

An  interesting  statistic  concerning  the  voting  population  was  the  number  of 
eligible  faculty  members  known  by  the  ith  voter.    As  the  ith  voter  becomes  acquainted 
with  more  faculty,  he  should  be  able  to  choose  better  for  he  is  more  familiar  with 
the  teaching  methods  of  the  eligible  population. 

Figure  2  presents  a  histogram  of  Mj,  the  number  of  eligible  faculty  members 
known  by  the  i"1  voter.    The  mean  or  average  number  of  faculty  members  known  by 
the  voting  population  was  16.8.    At  first  glance  this  appears  to  be  a  good  number, 
then  there  was  the  realization  that  a  ballot  must  have  hade  at  least  five  eligible  faculty 


19 


members  marked  known  before  it  was  considered  to  be  valid.    This  fact  along  with  a 
standard  deviation  of  9.7  showed  that  it  was  not  safe  to  assume  the  average  voter's 
choice  to  be  founded  on  a  large  base  of  experience.    Until  such  time  as  a  method 
can  be  devised  to  weight  the  ballots  based  on  the  voter's  experience,  it  should  suffice 
to  say  that  considering  the  wide  range  of  voter  experience  (1  to  8  quarters)  a  large 
varience,  94.7,  in  Mj  was  and  can  be  expected. 


400 


300 


o 

c 

3 


U- 


200 


100 


E[Mj]   =  16.8 


75 


Figure  2.    HISTOGRAM  OF  Mj 


100 


D.      DISTRIBUTION  OF  Nk 

Now  that  an  indication  of  how  many  faculty  were  known  on  each  ballot  has  been 
given,  it  would  prove  useful  to  discuss  how  many  ballots  indicated  acquaintance  with 
each  faculty  member.    Figure  3  gives  a  histogram  of  Nk,  the  number  of  voters 
identifying  teacher  k.    Table  VI  presents  the  frequency  table  used  for  this  discussion. 
The  mean  number  of  voters  who  know  teacher  k  was  82.9  with  a  standard  deviation 
of  62.5.    Of  special  interest  was  the  fact  that  514  people  indicated  they  knew  one 
teacher.    Due  to  this  phenomena  the  teacher  would  have  had  to  have  significantly 
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more  votes  than  the  others  in  order  to  place  high  in  the  standings.   This  pointed  out 
one  of  the  major  weaknesses  of  the  present  system  of  selection  which  is  expounded 
upon  in  subsection  E  Determination  of  Sk. 


50      100     150    200    250    300    350     400     450     500     550 

Nk 
Figure  3.    HISTOGRAM  OF  Nk 


Table  VI.    FREQUENCY  TABLE  OF  Nk 

CELL 

FREQUENCY 

1-  24 

22 

26-  50 

64 

51-  75 

56 

76-100 

61 

101-125 

44 

126-150 

16 

151-175 

11 

176-200 

6 

201-225 

5 

226-250 

3 

251-275 

0 

276-300 

1 

301-325 

0 

501-515 
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E.      DETERMINATION  OF  Sk 

After  the  balloting  data  had  been  transfered  to  magnetic  tape,  a  series  of  computer 
programs  were  run  to  determine  specific  statistics  from  the  data.    Appendix  B  contains 
a  listing  of  these  computer  programs.    One  of  the  first  important  statistics  determined 
was  the  score,  Sk,  of  each  professor.    In  order  to  perform  this  exercise  the  data  was 
transferred  to  magnetic  tape  by  the  use  of  the  computer  routine  "TRANSFER".    A 
second  computer  routine  "PROFSORT"  was  run  to  rearrange  the  data  from  ballot 
format  to  a  format  identifying  each  teacher,  Tfe.    That  routine  also  gave  a  frequency 
distribution  of  M{.    After  the  "PROFSORT"  routine  had  been  completed,  the  third 
routine,  "SCORSORT"  was  run  giving  a  printout  of  each  teacher  and  his  respective 
score  which  had  been  determined  as  follows: 

1.  Teacher  k's  first,  second,  and  third  place  votes  xx,  x2  and  x3  respectively 
were  divided  by  the  number  of  persons  identifying  teacher  k  in  Part  C  of 
the  ballot.    This  yielded  a  vector  Vk. 

2.  The  vector  Vk  was  multiplied  by  a  weighting  vector  W  and  the  product 
yielded  Sk,  the  score  for  teacher  k.  Mathematically  this  operation  was 
expressed  as 

sk  -  vk  •  w 

The  following  table  presents  a  summary  of  the  "SCORSORT"  printout  showing 
K  Sk,  Zk,  Nk,  Xlk,  X2k,  and  X3k  respectively. 

Table  VII.    SCORSORT  SUMMARY 


k 

sk 

Nk 

zk 

X1k 

x2k 

X3k 

1 

2.12121 

66 

140   ' 

►   26 

16 

4 

2 

2.08955 

134 

280 

59 

18 

8 

3 

1.84000 

25 

46 

8 

6 

2 

4 

1.82692 

104 

190 

38 

14 

10 

5 

1.77419 

31 

55 

11 

5 

1 

6 

1.69474 

95 

161 

29 

18 

9 

7 

1.68831 

77 

130 

27 

9 

4 

8 

1.63134 

217 

354 

58 

47 

28 

9 

1.59420 

69 

110 

20 

12 

6 

10 

1.55556 

99 

154 

25 

22 

10 

11 

1.53704 

54 

83 

15 

•  8 

7 

22 


Table  VII. 

SCORSC 

)RT  SUIW 

yiARY  (cc 

ntinued) 

k 

\ 

Nk 

Zk 

x1k 

X2k 

X3k 

12 

1.50000 

44 

66 

12 

5 

8 

13 

1.47312 

93 

137 

27 

11 

7 

14 

1.42857 

49 

70 

11 

10 

6 

15 

1.41935 

93 

132 

21 

19 

10 

16 

1.28571 

28 

36 

6 

4 

4 

17 

1.27907 

129 

165 

31 

15 

11 

18 

1.27149 

221 

281 

49 

31 

23 

19 

1.24528 

159 

198 

30 

30 

18 

20 

1.18103 

116 

137 

25 

16 

5 

21 

1.09917 

121 

133 

22 

12 

21 

22 

1.08929 

56 

61 

12 

6 

1 

23 

1.08696 

115 

125 

23 

11 

11 

24 

1.08197 

61 

66 

12 

6 

6 

25 

1.07200 

125 

134 

20 

22 

10 

26 

1.02083 

96 

98 

19 

6 

10 

27 

0.99415 

171 

170 

25 

25 

20 

28 

0.98718 

78 

77 

14 

7 

7 

29 

0.98077 

52 

51 

8 

8 

3 

30 

0.95652 

46 

44 

8 

5 

2 

31 

0. 94737 

57 

54 

10 

4 

6 

32 

0.91667 

96 

88 

14 

11 

10 

33 

0.91667 

24 

22 

3 

4 

2 

34 

0.89011 

91 

81 

14 

8 

9 

35 

0.86207 

29 

25 

5 

2 

1 

36 

0.82836 

134 

111 

15 

19 

13 

37 

0.80488 

82 

66 

8 

13 

8 

38 

0.79762 

84 

67 

7 

15 

9 

39 

0.78571 

28 

22 

2 

4 

6 

40 

0.77193 

57 

44 

9 

4 

0 

41 

0.72436 

156 

113 

17 

16 

13 

42 

0.70476 

105 

74 

15 

6 

2 

43 

0.70000 

100 

70 

12 

9 

4 

44 

0.70000 

20 

14 

0 

5 

4 

45 

0.68889 

45 

31 

2 

10 

3 

46 

0.68889 

45 

31 

4 

4 

7 

47 

0.68750 

32 

22 

4 

2 

2 

48 

0.68182 

110 

75 

12 

9 

9 

49 

0.67568 

74 

50 

3 

14 

10 

50 

0.66990 

103 

69 

13 

6 

5 

51 

0.66000 

50 

33 

5 

5 

3 

52 

0.65049 

103 

67 

9 

12 

7 

53 

0.64444 

90 

58 

10 

5 

8 

54 

0.63889 

36 

23 

4 

3 

1 

55 

0.63415 

82 

52 

9 

5 

6 

23 


Table  VII.    SCORSORT  SUMMARY  (Continued) 


k 

*k 

Nk 

Zk 

X1k 

X2k 

X3k 

56 

0.62821 

78 

49 

9 

2 

9 

57 

0.60938 

64 

39 

8 

3 

1 

58 

0.58511 

94 

55 

8 

8 

7 

59 

0.57798 

109 

63 

7 

12 

11 

60 

0.57463 

134 

77 

16 

4 

5 

61 

0.57317 

82 

47 

6 

9 

5 

62 

0.57143 

77 

44 

6 

8 

4 

63 

0.56522 

184 

104 

14 

20 

8 

64 

0.56436 

101 

57 

8 

9 

7 

65 

0.56383 

94 

53 

7 

7 

11 

66 

0.56250 

48 

27 

5 

1 

5 

67 

0.56000 

50 

28 

4 

4 

4 

68 

0.55670 

97 

54 

8 

3 

6 

69 

0.54369 

103 

56 

10 

3 

10 

70 

0.53226 

62 

33 

4 

6 

5 

71 

0.51961 

102 

53 

6 

13 

3 

72 

0.51948 

77 

40 

6 

5 

6 

73 

0.51515 

33 

17 

1 

5 

3 

74 

0.51316 

76 

39 

4 

9 

5 

75 

0.51304 

115 

59 

8 

8 

11 

76 

0.50769 

65 

33 

4 

6 

5 

77 

0.50549 

91 

46 

7 

6 

6 

78 

0.50000 

104 

52 

9 

6 

4 

79 

0.48837 

43 

21 

3 

4 

1 

80 

0.48780 

82 

40 

7 

3 

6 

81 

0.47500 

40 

19 

2 

4 

3 

82 

0.47287 

129 

61 

9 

9 

7 

83 

0.47170 

53 

25 

2 

6 

5 

84 

0.46087 

115 

53 

8 

7 

7 

85 

0.46067 

89 

41 

5 

7 

7 

86 

0.45455 

44 

20 

3 

3 

2 

87 

0.44828 

29 

13 

2 

1 

3 

88 

0.43662 

142 

62 

8 

12 

6 

89 

0.42991 

107 

46 

7 

7 

4 

90 

0.42391 

92 

39 

5 

6 

7 

91 

0.42308 

52 

22 

3 

3 

4 

92 

0.41758 

91 

38 

6 

4 

6 

93 

0.41045 

134 

55 

5 

11 

13 

94 

0.40909 

44 

18 

2 

2 

6 

95 

0.40288 

139 

56 

6 

11 

10 

96 

0.39286 

56 

22 

4 

1 

4 

97 

0.39286 

56 

22 

3 

3 

4 

98 

0.39024 

41 

16 

2 

3 

2 

24 


Table  VII. 

SCORSC 

(RT  SUMI 

VIARY  (cc 

intinued) 

k 

Sk 

Nk 

Zk 

x1k 

x2k 

x3k 

99 

0.38710 

124 

48 

6 

8 

8 

100 

0.37975 

79 

30 

3 

6 

6 

101 

0.36364 

77 

28 

5 

2 

4 

102 

0.36232 

69 

25 

4 

2 

5 

103 

0.36184 

152 

55 

6 

12 

7 

104 

0.35928 

167 

60 

4 

11 

22 

105 

0.35821 

67 

24 

4 

3 

2 

106 

0.35135 

111 

39 

3 

10 

7 

107 

0.35099 

151 

53 

8 

7 

7 

108 

0.34286 

140 

48 

6 

9 

6 

109 

0.33696 

92 

31 

5 

4 

3 

110 

0.33333 

117 

39 

2 

9 

13 

111 

0.33333 

36 

12 

2 

2 

0 

112 

0.33333 

33 

11 

2 

0 

3 

113 

0.33333 

30 

10 

1 

1 

4 

114 

0.33000 

100 

33 

3 

6 

9 

115 

0.32432 

111 

36 

5 

5 

6 

116 

0.31731 

104 

33 

5 

3 

7 

117 

0.31707 

41 

13 

2 

1 

3 

1  18 

0.31690 

142 

45 

6 

8 

5 

119 

0.31646 

79 

25 

2 

6 

5 

120 

0.30909 

110 

34 

5 

6 

2 

121 

0.30769 

65 

20 

0 

7 

6 

122 

0.30081 

123 

37 

7 

3 

3 

123 

0.29412 

68 

20 

•   1 

5 

6 

124 

0.29412 

17 

5 

0 

2 

1 

125 

0.28571 

35 

10 

2 

1 

0 

126 

0.28523 

298 

85 

11 

15 

11 

127 

0.28205 

39 

11 

2 

1 

1 

128 

0.27922 

154 

43 

7 

6 

3 

129 

0.27692 

65 

18 

3 

2 

2 

130 

0.27500 

40 

11 

2 

0 

3 

131 

0.27027 

185 

50 

*   8 

5 

8 

132 

0.25806 

62 

16 

2 

4 

0 

133 

0.25641 

39 

10 

1 

2 

2 

134 

0.25352 

71 

18 

2 

3 

4 

135 

0.24390 

41 

10 

1 

2 

2 

136 

0.24324 

37 

9 

1 

2 

1 

137 

0.24227 

194 

47 

5 

10 

7 

138 

0.23256 

86 

20 

2 

3 

6 

139 

0.22951 

61 

14 

1 

2 

6 

140 

0.22727 

66 

15 

0 

6 

3 

141 

0.22727 

22 

5 

1 

0 

1 

25 


Table  VII. 

SCORS( 

DRT  SUM 

iMARY  (c 

ontmued) 

k 

Sk 

Nk 

zk 

X 
1k 

X2k 

X 
3k 

142 

0.22642 

53 

12 

1 

3 

2 

143 

0.22500 

40 

9 

0 

3 

3 

144 

0.22222 

162 

36 

4 

6 

8 

145 

0.22000 

100 

22 

0 

6 

10 

146 

0.21875 

64 

14 

2 

2 

2 

147 

0.21698 

212 

46 

5 

10 

6 

148 

0.21384 

159 

34 

1 

10 

10 

149 

0.21053 

114 

24 

4 

3 

2 

150 

0.20988 

81 

17 

2 

2 

5 

151 

0.20952 

210 

44 

5 

6 

12 

152 

0.20588 

68 

14 

1 

3 

4 

153 

0.20561 

107 

22 

2 

3 

8 

154 

0.20000 

80 

16 

3 

1 

2 

155 

0.19863 

146 

29 

2 

7 

7 

156 

0.19780 

91 

18 

1 

4 

6 

157 

0.19091 

110 

21 

0 

6 

9 

158 

0.18288 

514 

94 

10 

19 

16 

159 

0.18000 

100 

18 

1 

2 

8 

160 

0.17647 

51 

9 

2 

0 

1 

161 

0. 1 7 143 

1 05 

18 

3 

o 

£. 

2 

162 

0.17045 

88 

15 

2 

3 

1 

163 

0.16867 

83 

14 

1 

4 

2 

164 

0.16783 

143 

24 

1 

7 

6 

165 

0.16667 

60 

10 

2 

0 

2 

166 

0.16667 

36 

6 

1 

0 

2 

167 

0.16250 

80 

13 

2 

2 

1 

168 

0.16250 

80 

13 

1 

2 

5 

169 

0.15337 

163 

25 

3 

5 

3 

170 

0.15126 

119 

18 

2 

2 

6 

171 

0.14894 

47 

7 

1 

0 

3 

172 

0.14815 

27 

4 

0 

2 

0 

173 

0.14783 

115 

17 

3 

2 

1 

174 

0.14516 

62 

9 

2 

0 

1 

175 

0.14493 

69 

10 

0 

3 

4 

176 

0.14458 

83 

12 

2 

2 

0 

177 

0.13861 

101 

14 

1 

2 

6 

178 

0.13580 

81 

11 

2 

1 

1 

179 

0.13433 

67 

9 

0 

4 

1 

180 

0.13333 

30 

4 

1 

0 

0 

181 

0.12903 

62 

8 

1 

2 

0 

182 

0.12821 

156 

20 

2 

4 

4 

183 

0.12821 

39 

5 

0 

1 

3 

184 

0.12745 

102 

13 

1 

2 

5 

26 


Table  VII. 

SCORSORT  SUMMARY  ( 

continued) 

k 

sk 

Nk 

Zk 

X1k 

X2k 

x3k 

185 

0.12727 

55 

7 

1 

0 

3 

186 

0.12658 

79 

10 

1 

2 

2 

187 

0.12381 

105 

13 

1 

2 

5 

188 

0.12245 

49 

6 

1 

1 

0 

189 

0.11905 

42 

5 

1 

0 

1 

190 

0.11864 

118 

14 

2 

2 

2 

191 

0.11538 

52 

6 

1 

0 

2 

192 

0.11483 

209 

24 

3 

4 

4 

193 

0.11215 

107 

12 

2 

1 

2 

194 

0.11009 

109 

12 

1 

2 

4 

195 

0.10784 

102 

11 

0 

4 

3 

196 

0.10588 

85 

9 

1 

1 

3 

197 

0.10526 

76 

8 

1 

1 

2 

198 

0.10448 

67 

7 

1 

1 

1 

199 

0.10345 

58 

6 

1 

0 

2 

200 

0.10345 

58 

6 

1 

1 

0 

201 

0.10300 

233 

24 

4 

3 

2 

202 

0.10227 

88 

9 

0 

4 

203 

0.10145 

69 

7 

0 

3 

204 

0.10112 

89 

9 

0 

4 

205 

0.10000 

30 

3 

0 

1 

206 

0.10000 

10 

1 

0 

0 

207 

0.09756 

41 

4 

1 

0 

0 

208 

0.09655 

145 

14 

1 

3 

4 

209 

0.08738 

103 

9 

1 

1 

3 

210 

0.08333 

180 

15 

0 

5 

5 

211 

0.08333 

72 

6 

0 

2 

2 

212 

0.08333 

24 

2 

0 

1 

0 

213 

0.08333 

24 

2 

0 

1 

0 

214 

0.08163 

49 

4 

0 

1 

2 

215 

0.08000 

50 

4 

1 

0 

0 

216 

0.07843 

51 

4 

0 

2 

0 

217 

0.07813 

64 

5 

1 

0 

1 

218 

0.07692 

52 

4 

0 

1 

2 

219 

0.07563 

119 

9 

1 

2 

1 

220 

0.07547 

53 

4 

1 

0 

0 

221 

0.07500 

80 

6 

1 

0 

2 

222 

0.07407 

108 

8 

1 

2 

0 

223 

0.07143 

14 

1 

0 

0 

1 

224 

0.07092 

141 

10 

0 

3 

4 

225 

0.06993 

143 

10 

0 

2 

6 

226 

0.06944 

72 

5 

0 

1 

3 

227 

0.06849 

73 

5 

0 

1 

3 

27 


Table  VII.    SCORSORT  SUMMARY  (continued) 


k 

\ 

Nk 

Zk 

x1k 

X2k 

x3k 

228 

0.06667 

15 

1 

0 

0 

1 

229 

0.05941 

101 

6 

0 

2 

2 

230 

0.05195 

77 

4 

0 

2 

0 

231 

0.05000 

40 

2 

0 

1 

0 

232 

0.05000 

20 

1 

0 

0 

1 

233 

0.04977 

221 

11 

2 

0 

3 

234 

0.0491  8 

183 

9 

0 

3 

3 

235 

0.04444 

45 

2 

0 

1 

0 

236 

0.04054 

74 

3 

0 

1 

1 

237 

0.04000 

50 

2 

0 

0 

2 

238 

0.03896 

77 

3 

0 

0 

3 

239 

0.03846 

26 

1 

0 

0 

1 

240 

0.03704 

81 

3 

0 

1 

1 

241 

0.03636 

55 

2 

0 

1 

0 

242 

0.03265 

245 

8 

0 

1 

6 

243 

0.03175 

63 

2 

0 

0 

2 

244 

0.03125 

64 

2 

0 

1 

0 

245 

0.02632 

38 

1 

0 

0 

1 

246 

0.02542 

118 

3 

0 

1 

1 

247 

0.02500 

40 

-i 
i 

0 

0 

1 

248 

0.02353 

85 

2 

0 

1 

0 

249 

0.02174 

92 

2 

0 

0 

2 

250 

0.02105 

95 

2 

0 

1 

0 

251 

0.02000 

50 

1 

0 

0 

1 

252 

0.01563 

64 

1 

0 

0 

1 

253 

0.01493 

67 

1 

0 

0 

1 

254 

0.01136 

88 

i 

0 

0 

1 

255 

0.01111 

90 

1 

0 

0 

1 

256 

0.01053 

95 

1 

0 

0 

1 

257 

0.00909 

110 

1 

0 

0 

1 

258 

0.00000 

244 

0 

0 

0 

0 

259 

0.00000 

123 

0 

0 

0 

0 

260 

0.00000 

97 

0 

0 

0 

0 

261 

0.00000 

63 

0 

*   0 

0 

0 

262 

0.00000 

56 

0 

0 

0 

0 

263 

0.00000 

55 

0 

0 

0 

0 

264 

0.00000 

55 

0 

0 

0 

0 

265 

0.00000 

50 

0 

0 

0 

0 

266 

0.00000 

50 

0 

0 

0 

0 

267 

0.00000 

50 

0 

0 

0 

0 

268 

0.00000 

47 

0 

0 

0 

0 

269 

0.00000 

44 

0 

0 

0 

0 

270 

0.00000 

41 

0 

0 

0 

0 
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Table  VII. 

SCORSORT  SUMMARY  (concluded) 

k 

sk 

Nk 

Zk 

x1k 

X2k 

X3k 

271 

0.00000 

39 

0 

0 

0 

0 

272 

0.00000 

35 

0 

0 

0 

0 

273 

0.00000 

34 

0 

0 

0 

0 

274 

0.00000 

32 

0 

0 

0 

0 

275 

0.00000 

31 

0 

0 

0 

0 

276 

0.00000 

29 

0 

0 

0 

0 

277 

0.00000 

29 

0 

0 

0 

0 

278 

0.00000 

28 

0 

0 

0 

0 

279 

0.00000 

27 

0 

0 

0 

0 

280 

0.00000 

23 

0 

0 

0 

0 

281 

0.00000 

23 

0 

0 

0 

0 

282 

0.00000 

20 

0 

0 

0 

0 

283 

0.00000 

19 

0 

0 

0 

0 

284 

0.00000 

18 

0 

0 

0 

0 

285 

0.00000 

14 

0 

0 

0 

0 

286 

0.00000 

14 

0 

0 

0 

0 

287 

0.00000 

9 

0 

0 

0 

0 

288 

0.00000 

6 

0 

0 

0 

0 

289 

0.00000 

6 

0 

0 

0 

0 

290 

0.00000 

2 

0 

0 

0 

0 

Sk  is  related  to  another  statistic,  Zk,  defined  by 


It  is  easily  recognized  that 


zk  "  gj  xik  •  w 


Sk=   Nk 


An  analysis  was  conducted  of  the  relationship  between  Zk  and  Nu,  where  Zk  was 
the  total  points  received  by  teacher  k  and  Nk  was  the  number  of  voters  familiar  with 
teacher  k.    A  scatter  diagram,  Figure  4,  was  constructed  and  it  was  concluded  from 
this  diagram  that  no  relationship  more  sophisticated  than  Zk  =  SkW"k  was  warranted. 

F.      DOMINANCE 

The  data  from  the  score  statistics  was  used  to  generate  other  statistics  to  be  used 
for  award  recipient  selection.    A  method  was  needed  to  reduce  the  number  of  eligible 
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Figure  4.    SCATTER  DIAGRAM  OF  ZR  vs  NR 
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recipients  without  resorting  to  subjective  guesses.    Two  methods  for  doing  this  were 
absolute  dominance  and  complete  dominance.    These  two  concepts  are  discussed  below. 
1.      Background 

Associated  with  each  teacher  k,  Tk,  are  statistics  which  give  specific  information 

about  the  individual.    These  include: 

X^  =  the  number  of  ith  place  votes  received  by  Tk 
Nk  =  Number  of  voters  knowing  Tk 

v'k  =  xVNk  =  fraction  on  ith  Place  votes  awarded  to  Tk  from  tne 
population  that  knew  him 

W  =  a  weighting  vector 

The  foUowing  structure  for  a  preferential  region  was  suggested  by  Professor 
T.  Gawain,  Chairman  of  the  first  Selection  Committee.  It  would  seem  logical  that  W 
would  be  constrained  such  that 

W-j    ^     Wo   >    Wo    >   0 

since  a  first  place  vote  should  be  worth  more  than  a  second  place  vote  which  in  turn  should 

be  worth  more  than  a  third  place  vote.    Further,  since  weighting  all  place  votes  the  same 

or  giving  one  of  the  places  a  zero  weight  would  be  contrary  to  requesting  three  separate 

rankings,  there  must  be  greater  restrictions  on  W.    In  fact,  it  would  seem  logical  to  have 

0   <  a1  <  w2/wx  £  b1    <1 
and  (2) 

0   <  a2  <  w3/w2  ^  b2  ^  1 

where  (alf  bx)  and  (a2,  b2)  define  a  preferential  region  interior  to  the  unit  square.    The 

values  of  a1?  a2,  bx  and  b2  would  be  chosen  based  on  a  determination  of  the  smallest 

and  largest  ratios  acceptable  for  the  three  rankings.    This  study  used 

a-^  =  a2  =  1/3 

and  _,„ 

bx  =  b2  =  2/3 

as  the  acceptable  parameters. 
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2.      Development 

It  is  desired  to  compare  Tk's  score,  Sk,with  other  teachers  scores,  Sk'.    The 
main  interest  lies  in  all  values  of  W  such  that 

sk  2.  Sk' 
or 

wlvlk  +  w2V2k  +  wlV3k  ^  wlVlk'  +  w2V2k'  +  w3V3k' 
for  all 


(3) 


(4) 


K'  f  K. 
rearranging  (3)  yields 

Wl(vlk-Vlk')  +  w2(V2k-V2k')  +  w3(V3k-V3k')  >  °- 
Now  if  all  values  of  Vik  -  Vik'  >  0,  i  =  1,2,3,  then  Sk>  Sk'  regardless  of  W  and  Sk' 
can  be  eliminated  from  competition.    Thus,  if  Tk  has  a  vector  Vk  such  that  Vik  >  Vik'  , 
i  =  1,2,3,  then  Tk  absolutely  dominates  Tk'.    This  form  of  dominance  is  absolute 

dominance. 

The  next  form  of  dominance  eliminates  all  teachers  who,  in  order  to  win, 
must  have  weighting  systems  that  violate  wx  >  w2  >  wg.    Divide  (4)  by  w2  and 
rearrange  yielding 

^3_         Vlk-Vlk     S     V2k-V2k>  if  V3k  -  V3k'  >  0,  (5) 

w     -  "  V3k-V3k'    w2  '  V3k-V3k'    '  otherwise  the  sense  of  the 

inequality  is  reversed 

Since  the  Vik  and  Vik'  values  are  known,  the  dominance  relationship  is  determined 
by  the  values  of  Wj,  i  =  1,2,3.    For  the  appropriate  values  of  Wj,  i  =  1,2,3,  Tk  is  not 

dominated  by  Tk'. 

Let  y  =  w3/w2  and  note  that  0  <  y  <.  1.    Let  X  =  Wl/w2  and  note  that 

1  <  X    Then  (5)  becomes 

"     V3k"V3k'  V3k"V3k' 

Figure  5  gives  a  plot  of  y  vs  x.    The  shaded  area  indicates  the  feasible  region 

for  weights. 
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Figure  5.    DOMINANCE  PLOT 


Now  consider  the  boundary 


y  = 


vlk-vlk 
V3k-V3k' 


X  + 


V2k,-V2k 
V3k-V3k' 


This  is  the  slope  intercept  form  of  the  equation  for  a  line.    Analysing  this  indicates 
that  for  Tk  to  be  completely  dominated  by  Tk'  either: 


1) 


2) 


Vlk'-Vlk 


V3k-V3k 


j    >  0  and  y(l)  >  1, 


Vlk'-Vlk 


)■  <  Oandy(l)<   0, 


v3k"V3k 
3)      V3k  "  V3k'  B  °  and 

a)      Vlk  -  Vlk.  <  0  and 


for  V3k  "  V3k'  >  ° 
forV3k-V3k'<° 


V2k-V2k' 
Vlk-Vlk' 


<1 


b>      Vlk  *  Vlk'  =  °  and  V2k  <  V2k' 
If  any  of  these  obtain ,     then  Tk  is  completely  dominated  by  Tk'  otherwise  there  is 
no  decision.    Tk  will  be  eliminated  if  he  is  completely  dominated  by  at  least  one  Tk'. 
3.      Results 

A  computer  routine  was  prepared  based  on  the  above  theory  and  dominance 
tests  were  run.  Table  VIII  presents  a  summary  of  the  data  used  and  the  results  of  the 
dominance  tests.    The  AD  column  lists  the  results  of  the  Abolute  Dominance  tests 
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employing  a  1  to  indicate  T^  is  absolutely  dominated  and  a  0  to  indicate  it  is  not 
absolutely  dominated.    The  CD  column  lists  the  results  of  the  Complete  Dominance 
tests  using  1  and  0  as  above  to  indicate  complete  domination. 


T, 


Table  VIII.    DOMINANCE  TESTS  RESULTS 


Ik 


V 


2k 


V 


3k 


AD 


CD 


1 

0.394 

0.242 

0.061 

0 

0 

2 

0.440 

0.134 

0.060 

0 

0 

3 

0.320 

0.240 

0.080 

0 

4 

0.365 

0.135 

0.096 

0 

5 

0.355 

0.161 

0.032 

1 

6 

0.305 

0.189 

0.095 

0 

7 

0.351 

0.117 

0.052 

1 

8 

0.267 

0.217 

0.129 

0 

9 

0.290 

0.174 

0.087 

1 

10 

0.253 

0.222 

0.101 

0 

11 

0.278 

0.148 

0.130 

0 

12 

0.273 

0.114 

0.182 

0 

13 

0.290 

0.118 

0.075 

14 

C.224 

0.204 

0.122 

15 

0.226 

0.204 

0.108 

16 

0.214 

0.143 

0.143 

0 

17 

0.240 

0.116 

0.085 

18 

0.222 

0.140 

0.104 

19 

0.189 

0.189 

0:113 

20 

0.216 

0.138 

0.043 

21 

0.182 

0.089 

0.174 

22 

0.214 

0.107 

0.018 

23 

0.200 

0.096 

0.096 

24 

0.197 

0.098 

0.098 

25 

0.160 

0.176 

0.080 

26 

0.198 

0.063 

0.104 

27 

0.146 

0.146 

0.117 

1 

28 

0.179 

0.090 

0.090 

29 

0.154 

0.154 

0.058 

30 

0.174 

0.109 

0.043 

31 

0.175 

0.070 

0.105 

32 

0.146 

0.115 

0.104 

33 

0.125 

0.167 

0.083 

34 

0.154 

0.088 

0.099 

35 

0.172 

0.069 

0.034 

36 

0.112 

0.142 

0.097 

37 

0.098 

0.159 

0.098 

34 


Table  VIII.    DOMINANCE  TESTS  RESULTS  (concluded) 


Ik 


'2k 


'3k 


AD 


CD 


38 

0.083 

0.179 

0.107 

1                          1 

39 

0.071 

0.143 

0.214 

0                         1 

40 

0.158 

0.070 

0.000 

41 

0.109 

0.103 

0.083 

42 

0.143 

0.057 

0.019 

43 

0.120 

0.090 

0.040 

44 

0.000 

0.250 

0.200 

0                         1 

45 

0.044 

0.222 

0.067 

46 

0.089 

0.089 

0.156 

47 

0.125 

0.063 

0.063 

48 

0.109 

0.082 

0.082 

49 

0.041 

0.189 

0.135 

0                         1 

50 

0.126 

0.058 

0.049 

1                          1 

G.      PAIRED  COMPARISONS 
1.      Development 

Assume  a  comparison  of  two  teachers.  Tu,  Tv\  under  the  constraint  that  the 
voters  must  know  each  of  them.    Let 


N 


o 


Nk,k' =  Z  yik  yik 

i=l 
where  N     =  total  number  of  ballots  and  y-^  is  an  indicator  function  whose  value 
is  one  if  ballot  i  was  acquainted  with  Tk  and  zero  otherwise.    Nk  k>  represents  the 
number  of  voters  who  knew  both  Tk  and  Tk>.    Note  that  Nk  k>  is  a  symmetric  matrix 
with  zeroed  diagonals. 

In  order  to  determine  the  scores  of  Tk  and  Tk>,  first  determine  Zk(k,k') 
and  Zk(k',k)  where  Zk(k,k')  represents  the  total  score  accumulated  by  Tk  from  the 
population  of  votes  that  knew  both  Tk  and  Tk>.    Thus, 

N_ 


and 


Zk(k,k')  =  £    yikyik>  (wjXjn,  +  w2Xi2k  +  w3Xi3k) 
i=l 

Zk(k',k)  =  57  yikyik,  (w1Xilk'+  w2Xi2k'+  w3Xi3k-) 
i=l 
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where,       X"k  is  the  number  of  jtn  place  votes  received  by  Tk  on  the  itn  ballot. 

Then, 

Sk(k,k')  -  Zk(k,k')/Nk?k, 

and 

Sk(k',k)  =  Zk(k',k)/Nkk, 

Sk(k,k')  represents  the  score  of  Tk  under  the  constraint  that  the  voters 
knew  both  Tk  and  Tk>.    A  similar  interpretation  can  be  made  for  Sk(k',k)  and  Tk'. 
Now  a  fraction  Sk(k,k')/Sk(k',k),  is  formed  so  that 

1)  If  Sk(k,k')  >  Sk(k',k)  the  value  is  greater  than  one. 

2)  If  Sk(k,k')<  Sk(k',k)  the  value  is  less  than  one. 

3)  If  Sk(k,k')  =  Sk(k',k)  the  value  is  one. 

A  reversal  is  noted  if  Sk  >  Sk'  and  2)  above  occurs  and  a  tie  if  3)  above  occurs.    By 
reversal  is  meant,  the  paired  comparison  fails  to  confirm  the  primary  ordering  of  the 
two  teachers.    The  significance  of  a  reversal  is  enhanced  the  greater  the  value  of  Nk  k>. 
2.      Results 

A  computer  routine  based  on  the  above  theory  was  run  using  the  data  and 
a  comparison  was  made  for  Tk,  k=l,  .  .  .  ,  7.    Table  IX  presents  the  results  of  that 
run.    In  the  table  N  is  the  number  of  voters  who  knew  both  Tk  and  Tk>. 

H.      COMMENTS 

All  individuals  passing  the  dominance  tests,  zeros  in  both  AD  and  CD,  had  the 
comment  section  of  the  ballots  identifying  them  scrutinized  and  an  abstract  was  made 
of  the  comments.    In  order  to  maintain  complete  objectivity  of  the  selection  committee 
all  references  to  name  or  department  were  removed  from  the  comment  abstract. 

I.       THE  SELECTION 

Once  all  of  the  forementioned  tests  were  performed  and  the  results  obtained,  a 
set  of  statistics   was  prepared  for  the  selection  committee.    This  set  of  statistics 
included: 
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Table  IX. 

PAIF 

}ED  COMPARISO 

NS 

Tl 

T2 

T3 

N 

Tk 

Vsk 

N 

Tk 

s2/sk 

N 

Tk 

S3/Sk 

38 

12 

129/142  <  1 

28 

9 

250/100   >  1 

4 

8 

025/250  <   1 

15 

2 

140/160  <  1 

22 

18 

250/045    >  1 

4 

10 

025/200  <   1 

10 

9 

190/160  >   1 

21 

17 

114/124  <   1 

3 

17 

033/033   =  1 

6 

18 

333/017  >  1 

17 

19 

082/106  <  1 

4 

13 

000/075  <  1 

15 

1 

160/140    >1 

4 

17 

150/250  <  1 

11 
10 
9 
9 
8 
6 

12 

6 

8 

10 

13 

4 

227/109     >1 
080/060    >1 
111/111    =   1 
100/022    >  1 
088/013    >1 
067/017    >  1 

N      T, 


T< 


V$k 


N      T. 


s5/sk 


N      T, 


VSk 


35 

14 

191/203  <  1 

7 

9 

200/144    >  1 

20 

17 

095/050   >  1 

15 

13 

133/033  >  1 

4 

8 

000/200  <  1 

10 

2 

060/080  <   1 

9 

8 

122/067    >  1 

3 

17 

000/067  <  1 

10 

8 

690/160  >  1 

6 

n 

Z 

017/067  <   1 

"2 

18 

200/067    >1 

5 

4 

1 60/000  >  1 

5 

6 

120/160  <  1 

5 

9 

200/04U  <    i 

4 

18 

000/000  -   1 

5 

19 

080/000  >  1 

4 

20 

100/000   >  1 

4 

13 

050/000  >   1 

3 

17 

000/000  =    1 

4 
3 
3 

20 
19 
18 

125/000  >   1 
000/000  =  1 
033/000    >  1 

N      T, 


s7/s 


7'^k 


27 

19 

17 

15 

6 

5 

4 

3 

3 


10 
19 
11 
18 
14 
16 
17 
8 
13 


078/111  < 
221/079  > 
194/041  > 
193/027  > 
067/100  < 
080/080  = 
000/050  < 
200/000  > 
000/133  < 
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1)  The  results  from  the  score  calculations 

2)  The  results  of  the  Dominance  Tests 

3)  The  results  of  the  paired  comparison  test 

4)  The  comment  abstract. 

After  deliberating  for  some  time  on  the  data,  a  decision  was  made  for  T2.  That 
individual  was  identified  to  the  selection  committee  as  Professor  E.  C.  Haderlie  of  the 
Department  of  Oceanography. 
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IV.    FURTHER  ANALYSES 

A.     BACKGROUND  AND  SUMMARY 

It  was  observed  last  year  by  Geary  [ref.  3]  that  the  distribution  of  scores  could 
be  represented  by  the  mixed  density 

fs(s)  =  q  for  s  =  0 

-  pXe*A-s  f or  s  >  0 

where  p  +  q  =  1  andX  >  0.    The  parameter  values  were  q  =  .177  and  A  =  2.09  for 
a  population  of  N  =  249  scores.    The  following  questions  were  raised: 

1.  Does  the  above  distribution  type  hold  again  this  year?    If  so,  have  the 
parameters  remained  the  same? 

2.  Is  the  distribution  of  scores  the  same  for  teachers  who  taught  the  quarter 
of  the  balloting  and  those  who  did  not?    If  not,  do  the  teachers  who  taught 
score  better? 

3.  Are  the  teacher  rankings  produced  this  year  in  concordance  with  those 
produced  last  year? 

These  questions  are  addressed  in    subsections  B,  C,  and  D. 
In  summary, 

1.  The  mixed  exponential  distribution  still  holds  qith  q  =  .114,  A  =  2.41 
and  N  =  290.    The  direction  of  the  parameter  changes  was  noteworthy  in 
that  it  supported  the  hypothesis  that  the  award  was  encouraging  better 
teaching  on  a  broad  scale.    The  proportion  of  zero  scores  had  decreased 
and  the  positive  scores  had  smaller  variability. 

2.  The  segregating  of  teachers  into  two  groups,  those  who  taught  in  the 
quarter  of  the  balloting  and  those  who  did  not,  resulted  in  score  distri- 
butions which  were  still  of  the  exponential  type,  but  the  parameterization 
changed.    It  was  believed  that  those  who'  did  not  teach  would  have  lower 
scores,  but  the  results  were  not  conclusive.    This  is  discussed  in  subsection  C. 

3.  The  Kendall  Concordance  Coefficient  was  computed.  The  value  of  0.77 
was  mildly  high,  significantly  above  zero,  but  also  significantly  less  than 
one. 
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B.      SCORE  DISTRIBUTION  STUDY 

Figure  6  is  a  histogram  of  Sk,  the  score  of  teacher  k,  s  >  0,  for  FY  '71.    Note 
the  reverse  J-shape  which  indicates  there  is  a  good  chance  for  the  distribution  of 
the  scores  to  be  exponential.    The  data  for  FY  '70  had  a  similar  histogram  and 
Lieutenent  Robert  Geary  [ref.  3]  showed  that  the  data  was  exponential  with  a 

density  function 

fs(s)  =  2.09  e_2-09s,  s  >  0. 

A  similar  assumption  was  made  this  year  and  the  maximum  likelihhod  estimation 
procedure  for  the  parameter  A  was  used.    This  results  in 

\ 

where  x  is  the  mean  of  the  sample  of  positive  scores  and     is  the  parameter  used  in 
the  exponential  density  function.  Recall  from  Barr  [ref.  1]  that  the  probability 
density  function  of  an  exponential  function  is 

fx(x)  =     e^x,  x  >  0 

The  log  of  the  likelihood  equation  is 

n  lnX  -  X^Ujfj 

where  Uj  is  the  cell  midpoint  and  fj  is  the  cell  frequency.    Setting  the  derivative  of 
the  above  with  respect  to  A  equal  to  zero  yields 

thus 

\  1    n 

X-i/Jl  ujfj. 

J=l 
Tables  X  through  XVII  show  the  data  breakdown  of  the  FY  70  and  FY  71  data. 

Table  XVIII  shows  the   Xvalues. 
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Table  X.    CHI  SQUARE  TEST  DATA  FY  70  ALL 


j 

k 

Ui 

Fi 

Ujhj 

Pi 

INK: 

1-j/iNI-j 

1 

1 

.05 

42 

2.10 

.1894 

38.83 

45.43 

2 

2 

.15 

34 

5.10 

.1601 

32.82 
25.26 

35.22 

3 

3 

.25 

23 

5.75 

.1232 

20.94 

4 

4 

.35 

27 
13 
13 

9.45 

.0999 

20.48 

35.60 

5 

5 

.45 
.55 

5.85 

.0844 

17.30 

9.77 

6 

6 

7.15 

.0650 

13.33 

12.68 

7 

7 

.65 
.75 
.85 

5 
11 

7 

3.25 
8.25 

.0526 

10.78 

2.32 

8 

8 

.0427 

8.75 

13.83 

9 

9 

5.95 

.0361 

7.40 
5.70 

8.51 
2.99 

6.62 
8.60 

1.88 
8.36 

10 

10 

.95 

7 

6.65 

.0278 

.0415 
.0146 

11 
12 

11 

1.05 
1.15 
1.25 

1 
3 
5 

1.05 
3.45 
6.25 

13 

12 

14 
15 
16 

17 

13 

1.35 
1.45 
1.55 
1.65 

1 
1 
1 
2 
4 

1.35 
1.45 
1.55 
3.30 
7.00 

.0359 
.0051 

7.36 
1.05 

3.40 

18 

n_9 

20 
21 
22 
23 

24 

14 
15 

1.75 

15.24 

1   oc 

i  .  *-*-> 

1.95 
2.05 
2.15 
2.25 
2.35 

0 
0 
1 
0 
1 
3 

0.00 
0.00 
2.05 
0.00 
2.25 
7.05 

.0217 

4.45 

5.62 

N=205     ZUif:=96.25 


24 

£    Ujfj  =  .4695 

j=1 


-       1 

n  .   ,      J  J 


A=  1=  2.13 
x 

*15-2,.05  =  E     Fk/NPk  •  N  -  20.49 
k=1 
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Table  XI.    CHI  SQUARE  TEST  DATA  FY  70,  Q3,  TEACHING 


1     24 
x  =  -  Z     Ujf:  =  .47156 

n  j=1       '  ' 


A 

\=  ==  2.12 
n 


X13-2  =    Z    Fk2/NPk  "   N   =   1115 
k=l 


j 

k 

Ui 

Fi 

UiFi 

pi 

NPj 

Fj/NPj 

H 

1 

.05 

31 

1.55 
3.75 

.1894 

28.98 

33.16 

hr" 

2 

.15 

23 

.1536 

23.50 

26.60 

3 

3 

.25 

18 

4.50 

.1297 

19.84 

16.33 

4 

4 

.35 

22 

7.70 

.0999 

15.28 

31.68 

5 

5 

.45 

10 

4.50 

.0809 

12.38 
10.05 

8.08 
2.46 

6 

6 

.55 

5 

2.75 

.0657 

7 

7 

.65 

4 
7 

2.60 
5.25 

.0532 
.0449 
.0347 

8.14 
6.87 

1.97 
7.13 

8 

8 

.75 

9 

9 

.85 

7 

5.95 

5.31 

9.23 
11.45 

5.64 

10 

10 

.95 

7 
1 
1 
5 

6.65 
1.05 
1.15 
6.25 

.0280 
.0567 

4.28 
8.68 

11 

12 
13 
14 
15 
16 
17 
18 

11 
12 

1.05 
1.15 
1.25 

1.35 
1.45 
1.55 
1.65 

1.75 

1 

0 

1 

1 

4 

0 

0 

0 

0 

1 

2 
N=153 

1.35 
0.00 
1.55 
1.65 
7.00 
0.00 
0.00 
0.00 
0.00 
2.25 
4.70 

Zujff 

.0414 
•   .0219 

6.33 

3.35 

7.74 

2.69 

19 

20 
21 
22 
23 

24 

13 

1.85 

1.95 
2.05 
2.15 
2.25 
2.35 

=72.15 
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Table  XII.   CHI  SQUARE  TEST  DATA  FY  70,  Q3,  NOT  TEACHING 


j 

k 

Ui 

Fi 

UjFj 

pj 

NPj 

Fj/NPj 

1 

1 
2 

.05 
.15 

11 

9 

.55 
1.35 

.1975 
.1520 

10.27 

11.78 

7.90 

10.25 

2 

3 

3 

.25 

5 

1.25 

.1285 

6.68 

3.74 

4 
5 
6 

4 
5 

.35 
.45 
.55 

5 
3 
8 

1.75 
1.35 
4.40 

.1824 

9.48 

6.75 

.0671 

3.49 

18.34 

7 
8 

6 

.65 

.75 

1 

4 
0 

.65 
3.00 

.0952 

4.95 

5.05 

9 

.85 

0.00 

10 

.95 

0 

0.00 

11 

1.05 

0 

0.00 

12 

1.15 

2 

2.30 

■ 

13 

1.25 

0 

0.00 

14 

1.35 

0 

0.00 

15 

1.45 

1 

1.45 

16 

1.55 

0 

0.00 

17 

1.65 

1 

1.65 

18 

1.75 

0 

0.00 

19 

1.85 

0 

0.00 

20 

1.95 

0 

0.00 

21 

2.05 

1 

2.05 

22 

2.15 

0 

0.00 

23 
1  24 

7 

2.25 
2.35 

0 

1 

0.00 
2.35 

.1773 

9.22 

3.90 

i   ^-^    - 

N=52 

£u,ff 

=24.1 

x  = 

1    24 

I  Z  Ujf| 
n  j=i    M 

=  .46346 

^      1 

\=  i  =  2.16 


X7-2  05  "    I    Fk/NPk  -  N  =  7-82 
z'  k=1 
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Table  XIII.  CHI  SQUARE  TEST  DATA  FY  70,  Q4,  TEACHING 

k  Uj             Fj          UiFj              Pj                NPj                Fj/NP; 

j  Q5           30          1.50           .1975             28.44             31.65 

2  15           26          3.90           .1585             22.82             29.62 

3  25           13         3.25           .1323             19.05               8.87 


.55 


.65 


.75 


N=144     ZU:F:=64.8 


1   24 
x  =  1  Z      UiFi  =  -450 


n    ;_ 


i=i 


A_  !      _ 


X=  =    =  2.22 


Xl3-2,.05  "    S      FJ7NPk  -  N  =  9.10 
k=1 


•^           21          7.35           .1010             14.54             30.33 
^45  9         4.05  .0811  11.68 6jB 


11  6  05  .0651  9.37  12.91._ 

5  3.25  .0523  7.53  3.32 

5  3.75  -0436  6.28  3.98 

5  4.25  .0333  4.80  5.21 


9  9           .85  5 

10  1Q           .95  5  4.75          .0267              3.84 6S\_ 

"TT  Tol  1  1-05 

12  1.15  2  2.30 

13  11  1  95  3  3.75           .0530               7.63               4.72 
TT  1.35  0  0.00 

15  1.45  1  1-45 

16  1.55  0  0.00 

17  1.65  1  1.65 
ig  10          1,75 2  3.^0           .Oj/j 3-=>  I t^S    j 

"fg  Utf  0  0.00 

20  1.95  0  0.00 

21  2.05  1  2.05 

22  2.15  0  0.00 

23  2.25  1  2.25 

24  13          2.35  2 


4.70  .0183  2.64 6.06 
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Table  XIV. 

CHI  SQUARE  Tl 

EST  DAT/ 

\  FY  70,  Q 

4,  NOT  TE£ 

.CHING 

J 

k 

ui 

Fi 

UjFj 

P) 

NPj 

Fj/NPj 

1 

1 

.05 
.15 

12 
8 

.60 
1.20 

.1730 
.1499 

10.55 
9.14 

13.65 

7.00 

2 

2 

3 

3 

.25 

10 

2.50 
2.10 
1.80 

.1172 

7.15 

13.99 

4 

4 

.35 

6 
4 

.1015 

6.19 

5.82 

5 

.45 

6 

5 

.55 

2 

1.10 

.1449 

8.84 

4.07 

7 

.65 

0 

0.00 

8 

6 

.75 

6 

4.50 

.1013 

6.18 

5.82 

9 

.85 

2 

1.70 

10 

.95 

2 

1.90 

11 

1.05 

0 

0.00 

12 

7 

1.15 

1 
2 

1.15 
2.50 

.1149 

7.01 

2.57 

13 

1.25 

14 

1.35 

1 

1.35 

15 

.145 

0 

0.00 

16 

8 

1.55 

1 

1.55 

.0523 

3.19 

5.02 

17 

1.65 

1 

1.65 

15 

-i  ir 

9 

-3   SCl 

■ .  /  _> 

•*- 

->  .->  ^ 

19 

1.85 

0 

0.00 

20 

1.95 

0 

0.00 

21 

2.05 

0 

0.00 

22 

2.15 

0 

0.00 

23 

2.25 

0 

0.00 

24 

9 

2.35 

1 

2.35 

.0450 

2.75 

5.82 

N=61     IU:F;=31.45 


24 


1^ 
n  i 


-  Z    UjFj  =  .5156 


^       1 

X=  =  =  1.94 
x 


2  l     p2 

x9-2,.05  =    Z     Fk/NPk  -  N  =  3.75 

k=1 
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Table  XV.  CHI  SQUARE  TEST  DATA  FY  71,  ALL 


j 

k 

U) 

Fi 

UjFj 

PJ 

NPj 

hj/NKj 

1 

1 

.05 

53 
51 

2.65 
7.65 
7.75 

.2212 

56.85 

49.41 

2 

2 

.15 

.1600 
.1320 

41.12 
33.92 

63.25 

28.33 

3 

3 

.25 

31 

4 

4 

.35 

27 

9.45 

.1039 

26.70 

27.70 

5 

5 

.45 

18 

8.10 
11.00 

.0847 
.0636 

21.77 
16.35 

14.88 
24.46 

6 

6 

.55 

20 

7 

7 

.65 

15 

9.75 

.0501 

12.88 

17.47 

8 

8 

.75 

5 

3.75 

.0393 

10.10 

2.48 

9 

9 

.85 

4 

7 

3.40 
6.65 

.0310 
.0244 

7.97 
6.27 

2.01 
7.81 
7.33 

10 

10 

.95 

11 

11 

1.05 

6 

6.30 

.0191 
.0260 
.0179 

4.91 

12 
13 

12 

1.15 
1.25 

1 
4 

1.15 
5.00 

6.68 
4.60 

3.74 
3.48 

14 
15 

13 

1.35 
1.45 

0 

4 

0.00 
5.80 

16 

17 

14 

1.55 
1.65 
1.75 
1.85 
1.95 
2.05 
2.15 

3 
3 
1 
2 
0 
1 
1 

4.65 
4.95 
1.75 
2.70 
0.00 
2.05 
2.15 

.0104 

2.67 

13.48 

18 
19 
20 
21 
22 

14 

.0164 

4.21 

5.94 

N=257     ZUjFp106.65 


-       1 
x  =  - 
n  j= 


22 

Z      UjF:  =  .4149 


\=  I  =  2.41 


*15-2,.05  =    fc    F2k/NPk-N  =  14.38 
k=1 
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Table  XVI.    CHI  SQUARE  TEST  DATA  FY  71,  Q3,  TEACHING 


N=186     ZUjFj=81.8 


x  =  r  l    uiFi  =  -439 


ni=i 


X= 


=  2.27 


X14-2,.05  =    Z      Fk/NPk-  N  =  5-09 


k=1 


j 

k 

U) 

Fi 

UjFj 

Pi 

NPj 

Fj/NPj 

1 

1 

.05 

40 

2.00 

.2055 

38.22 

41.86 

2 

2 

.15 

29 

4.35 

.1569 

29.18 

28.82 

3 

3 

.25 

20 

5.00 

.1310 

24.37 

16.41 

4 

4 

.35 

22 

7.70 

.1041 

19.36 

25.00 

5 

5 

.45 

15 

6.75 

.0827 

15.38 

14.63 

6 

6 

.55 

14 

7.70 

.0631 

11.74 

16.70 

7 

7 

.65 

13 

8.45 

.0528 

9.82 

17.21 

8 

8 

.75 

5 

3.75 

.0419 

7.79 

3.21 

9 

9 

.85 

4 

3.40 

.0320 

5.95 

2.69 

10 

10 

.95 

5 

4.75 

.0267 

4.97 

5.03 

11 

11 

1.05 

4 

4.20 

.0212 

3.94 

4.06 

12 

13 

12 

1.15 
1.25 

1 
3 

1.15 

3.75 

.0298 

5.54 

2.89 

14 

15 
16 
17 

13 

1.35 
1.45 
1.55 
1.65 

0 
3 
1 
2 

0.00 
4.35 
1.55 
3.30 

.0312 

5.80 

6.21 

18 
19 
20 
21 
22 

14 

1.75 
1.85 
1.95 
2.05 
2.15 

1 
2 
0 
1 
1 

1.75 
3.70 
0.00 
2.05 
2.15 

.0211 

3.92 

6.38 
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Table  XVII. 

CHI  SQ 

UARE  T 

EST  DAT/: 

i  FY  71,  L 

L3,  NU  1     Itfl 

UMIIMU 

i 

k 

U) 

,Fi 

uiFi 

pi 

NPj 

Fj/NPj 

i 

1 

.05 

13 
22 
11 

.65 
3.30 
2.75 

.2442 
.1788 
.1410 

17.34 
12.69 
10.01 

9.75 
38.14 
12.09 

2 

2 

.15 

3 

3 

.25 

4 
5 

4 

.35 
.45 
.55 
.65 

5 
3 
6 
2 

1.75 
1.35 

.1844 

13.09 

4.89 

6 

7 

5 

3.30 
1.30 

.1065 

7.56 

8.47 

8 

.75 

0 

0.00 

9 

.85 

0 

0.00 

10 

.95 

2 

1.90 

11 

1.05 

2 

2.10 

12 
13 

6 

1.15 
1.25 
1.35 

0 
1 
0 

0.00 
1.25 
0.00 

.1172 

8.32 

3.00 

14 

15 

1.45 

1 

1.45 

16 

1.55 

2 

3.10 

17 

1.65 

1 

1.65 

18 

1.75 

0 

0.00 

19 

1.85 

0 

0.00 

20 

1.95 

0 

0.00 

21 

22 

7 

2.05 

2.15 

0 
0 

0.00 
0.00 

.0279 

1.98 

8.08 

N=71 

ZUjFp 

25.85 

x  = 

1    22 

UjF:     =     . 

364 

"  j=1 
\=  I     -  2.75 


X7-2,.05   =    I     Fk/NPk-N  =   13'41 


k=1 
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Table  XVIII.         VALUES 

FY  70  FY  71 

Group  Q3  Q4  Q3 

All  Teachers  2.13  2.13  2.41 

Those  Teaching  2.12  2.22  2.27 

Those  Not  Teaching         2.16  1.94  2.75 

A  Chi-Square  Goodness-of-Fit  Test  was  used  to  test  the  hypothesis  that  the 
density  functions  determined  using  the  parameters  above  were  valid  representations  of 
their  respective  data.    The  null  and  alternate  hypotheses  for  the  above  functions  were 

H0:  fs(s)  =  Ae-A-S,  s>  0 

H-^:  Hq  false, 

where  A  is  the  value  for  the  parameter  of  the  density  function,  n  is  the  number  of 

positive  scores,  I1,  I2,  .  •  •  Ir  represents  the  scoring  intervals,  Pj  =  P(S£lj)  under  Hq, 

np;  is  the  expected  number  of  entries  in  Ij  under  Hq  and  Fj  is  the  number  of  observed 

entries  in  L. 

Define 

r     (Fj.NPj)2         ,    j_ 

j=i    npj     ANpj 

where  N  =    Z  F:.    As  n  gets  large,  z  approaches  the  Chi-square  distribution  function 

J      J 
with  r-2  degrees  of  freedom 

Thus  let 

ptxr-2,(l<l)  >  0bs  TslH0l  =  P 

Compare  p  with CL  and  if 

1.  p  <  CL  then  reject  Hq, 

2.  p  >   d  then  accept  Hq. 
The  values  determined  for  p  were : 
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Table  XIX.    p  VALUES 


Group 

Q3 

FY  70 
Q4 

FY  71 
Q3 

All  Teachers 

.084 

.084 

.350 

Those  Teaching 

.403 

.613 

.995 

Those  Not  Teaching 

.168 

.800 

.030 

Thus,  it  was  concluded  from  the  p  values  that  Hq  could  not  be  rejected  for 
reasonable  levels  of  significance. 

C.      TEACHING  EFFECT 

The  author  felt  a  reasonable  question  arose  during  the  data  manipulation  con- 
cerning the  effect  of  teaching  during  the  voting  quarter  on  a  teacher's  ranking.    It 
seemed  logical  that  a  voter  would  be  more  likely  to  rank  a  teacher  who  was  currently 
instructing  than  one  who  was  off  for  the  quarter.    This  assumption  was  based  on  the 
conjecture  that  a  person  is  more  likely  to  hold  a  stronger  opinion  of  a  teacher  he 
is  associating  with  at  the  time  than  one  he  has  had  in  the  past. 

To  test  this  hypothesis  it  would  be  best  to  remove  all  non-student  ballots,  but 
this  was  not  possible  due  to  time  constraints.    The  faculty  from  the  Navy  Management 
Systems  Center  were  removed  from  the  data  for  they  do  not  teach  by  quarters. 

Care  had  to  be  exercised  for  during  the  FY  70  period  the  balloting  was  done  at 
the  start  of  Quarter  4,  Q4.    Since  it  was  felt  that  strong  opinions  could  not  be 
formed  during  the  first  two  weeks  of  a  quarter,  the  data  for  Q3  was  also  gathered. 
The  FY  71  period  did  not  present  the  problem  for  the  balloting  was  done  near  the 
end  of  Q3  for  that  year. 
Using  the  model 

fs(s)  =  q,      s  =  0 

=  pAe^s,     s  >  0 
it  is  desired  to  test 

H0:  q1  =  q2  and    \1  =  A2 


51 


against 

H]_:  q2>  Qi        and    A  2  >  Ai 

The  author  knows  of  no  standard  practice  for  this  statistical  problem.    The  following 

ad  hoc  discussion  will  shed  some  light  on  the  question. 

Reject  H0  if  q2  is  sufficiently  larger  than  q:  and  A2  is  sufficiently 
larger  that  A*. 

However,  these  estimates  are  not  statistically  independent  and  joint  probability 

^     \ 
statements  concerning  them  are  difficult  to  calculate.    In  lieu  of  this,  the  pairs  A^,  A  2 

A         A 

are  examined  separately  from  q-^,  q2- 

Table  XVIII  showed  thatA2  >  Aj  in  Quarter  3  of  both  years,  but  A2  <  Aj  in 
Q4  of  FY  70.    Thus,  the  direction  of  the  shift  was  consonant  with  the  discussion  at 
the  beginning  of  this  section.    To  determine  the  significance  of  the  change,  some 
distribution  theory  is  required. 


Since  a 

2 


Ao  nn     Xi 


where  x-  is  the  sum  of  positive  scores  for  group  i  and  ni  is  the  number  of  positive  scores; 
and  since  a  positive  score  has  an  exponential  distribution,  it  follows  that 

Xi~r(ni,A),2AXi~  X(2rH) 


and  it  follows  that  A 

A2 


%^  '2ni,2n2- 

The  p  values  are  listed  in  Table  XX. 

Table  XX.    p  VALUES  FOR  A2/A-, 


Year 

Quarter 

Test  Statistic 

d.f. 

Approx.  p  Value 

1970 

3 

2.16/2.12=  1.019 

104/306 

.40 

1970 

4 

1.94/2.22  =  0.874 

122/288 

.75 

1971 

3 

2.75/2.27  =  1.211 

142/372 

.05 
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Turning  to  q\  and  q2,  the  normal  approximation  will  be  used  in  the  two  sample 
case.  Let 

hi  =  percentage  of  zeroes  of  those  professors  teaching  during  the  observed 
quarter. 

ho  =  percentage  of  zeroes  of  those  professors  not  teaching  during  the  observed 
quarter. 


Then 


h  = 


nlhl  +  n2h2 


n-i  +n 


1TU2 


where  h  is  the  pooled  percentage  of  all  teachers,  n-L  is  the  number  of  professors  teaching 
during  the  observed  quarter,  and  n2  is  the  number  of  professors  not  teaching  during  the 
observed  quarter.  Now  let 

O  =  N/h(l-h)(l/ni  +  l/n2)      , 
then  from  Brownlee  [ref.  2] 

(h2  -  l/2n2)  -  (h!  +  l/2ni)         

A —  N(0,1) 

G 

using  this  formula,  solving  for  p  values  yields 

Table  XXI.    p  VALUES  FOR  q  TEST 


Observed  Quarter 

p  Value 

Q3,  FY  70 

.14 

Q4,  FY  70 

.79 

Q3,  FY  71 

.09 

Again,  the  direction  of  the  change  supported  the  discussions  at  the  beginning  of 
this  section,  but  the  results  were  not  significant  using  this  as  hoc  approach.    A  sharper 
analysis  may  or  may  not  give  more  significant  support  to  this  phenomenon.    Such  an 
analysis  would  include 

1.  Removal  of  the  non-student  ballots 

A        A 

2.  Correct  joint  probability  statements  concerning  Aj,  A2,  q^,  and  q2. 
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D.      CONCORDANCE  ESTIMATION 

Suppose  that  X  =  (Xa,  X")  has  a  bivariate  cumulative  distribution  function 
F(xa,xlD),  then  the  vectors  x-i  and  X2  are  said  to  be  concordant  if  x-^  -  X£  and 
x-i  -  xo  have  the  same  sign.    Further,  using  Kendall's  [ref.  5]  Coefficient  of  Concordance 
the  commonality  of  two  sets  of  data  can  be  determined.    If  the  test  is  performed  and 
the  coefficient  of  concordance  is  near  one,  the  two  sets  of  data  show  similar  ranking. 
The  further  the  coefficient  is  from  one,  near  zero,  the  worse  the  relationship.    Thus 
this  test  can  be  used  to  determine  if  a  teacher  scoring  high  one  year  is  likely  to  score 
high  the  next.    Also,  it  can  be  determined  if  the  students  rank  the  teachers  the  same 
each  year. 

Kendall,  [ref.  5] ,  defines  the  relationship  as 

w  _  12S 

m2(n3  -  n)  -  12m  ZTj 

where  S  is  the  sum  of  squares  of  actual  deviations,  n  is  the  number  of  rankings,  m 
is  the  number  of  raters,  Tj  =  Z^t3  -  t),  and  t  indicate  ties. 

Table  XXII  is  a  2  x  222  matrix  of  rankings  determined  from  the  scores..  The 
first  row  represents  the  ranking  of  teachers  in  FY  70  and  the  second  row  represents 
the  ranking  of  the  teachers  in  FY  71.    The  choice  of  222  teachers  was  made  so  that 
the  population  would  include  only  professors  eligible  both  years. 

From  this  table  the  values  of  the  equation  take  the  form 

=  12(2743884.46) 


(2)2  [(222)3  -  222]  -  12(2)  (47838) 

yielding 

W  =  .77264 

Kendall  also  expressed  a  method  to  determine  the  significance  of  the  Concordance 

Coefficient.    Let 

2  12S 

Xr    =  m(n-l)  W  = 


mn(n+l) 


where  r  =  n-1,  yielding 
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Table  XXII.    CONCORDANCE    MATRIX 


FY  70 

1 

2 

3 

4 

5 

6 

7 

8 

9 

.10 

11 

FY  71 

8 

2 

5 

12 

1 

4 

37 

26 

18 

7 

16 

Total 

9 

4 

8 

16 

6 

10 

34 

34 

27 

17 

27 

FY  70 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

FY  71 

19 

194 

25 

41 

30 

11 

9 

79 

136 

33 

40 

Total 

31 

207 

39 

56 

46 

28 

27 

98 

156 

54 

62 

FY  70 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

FY  71 

28 

130 

13 

34 

162 

10 

51 

114 

24 

6 

181 

Total 

51 

154 

38 

60 

189 

38 

80 

144 

55 

38 

214 

FY  70 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

FY  71 

74 

20 

29 

21 

14 

52 

75 

26 

23 

176 

48 

Total 

108 

55 

65 

58 

52 

91 

115 

67 

65 

219 

92 

FY  70 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

FY   71 

177 

58 

111 

83 

142 

62 

17 

189 

15 

65 

61 

Total 

222 

104 

158 

131 

191 

112 

68 

241 

68 

119 

116 

FY   70 

56 

57 

58 

59 

60 

r  -\ 
O  1 

62 

63 

64 

65 

66 

FY   71 

100 

96 

59 

39 

31 

42 

134 

72 

70 

108 

137 

Total 

156 

153 

117 

98 

91 

103 

196 

135 

134 

173 

203 

FY   70 

67 

68 

68 

70 

71 

72 

73 

74 

75 

76 

77 

FY   71 

131 

129 

57 

37 

35 

121 

143 

55 

56 

98 

32 

Total 

198 

197 

125 

107 

106 

193 

216 

129 

131 

174 

109 

FY   70 

78 

79 

80 

81 

82 

83 

84 

85 

86 

87 

88 

FY   71 

122 

46 

123 

135 

33 

49 

83 

109 

131 

65 

88 

Total 

200 

125 

203 

216 

115 

132 

167 

194 

217 

152 

176 

FY   70 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

FY   71 

133 

84 

89 

60 

150 

87 

171 

73 

54 

126 

138 

Total 

222 

174 

180 

152 

243 

181 

266 

169 

151 

224 

237 

FY  70 

100 

101 

102 

103 

104 

104 

106 

107 

108 

109 

110 

FY  71 

154 

134 

82 

116 

64 

166 

80 

125 

113 

197 

146 

Total 

254 

225 

184 

219 

168 

270 

186 

232 

221 

306 

256 

FY   70 

111 

112 

113 

114 

115 

116 

116 

118 

119 

120 

121 

FY   71 

77 

129 

94 

71 

88 

127 

91 

147 

106 

148 

128 

Total 

188 

241 

207 

185 

203 

243 

207 

265 

225 

268 

249 
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Table  XXII.    CONCORDANCE    MATRIX  (concluded) 


FY  70 

122 

123 

123 

123 

126 

127 

128 

129 

129 

131 

132 

FY  71 

105 

204 

145 

22 

53 

93 

65 

165 

90 

149 

104 

Totals 

227 

327 

268 

145 

179 

220 

193 

294 

219 

280 

236 

FY  70 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

FY  71 

193 

45 

188 

44 

68 

206 

201 

50 

95 

198 

183 

Total 

326 

179 

323 

180 

205 

344 

340 

190 

236 

340 

326 

FY  70 

144 

145 

146 

147 

148 

149 

150 

151 

152 

153 

154 

FY   71 

170 

159 

102 

175 

69 

173 

178 

140 

139 

63 

119 

Total 

314 

304 

248 

322 

217 

322 

328 

291 

291 

216 

273 

FY  70 

155 

156 

157 

158 

159 

160 

161 

162 

163 

164 

165 

FY  71 

117 

166 

206 

172 

192 

115 

166 

158 

181 

202 

203 

Total 

272 

322 

363 

330 

351 

275 

327 

320 

344 

366 

368 

FY  70 

166 

167 

168 

169 

170 

171 

172 

173 

174 

175 

176 

FY  71 

99 

101 

152 

161 

174 

47 

180 

107 

112 

92 

206 

Total 

265 

268 

320 

330 

344 

218 

352 

280 

286 

267 

382 

FY   70 

-1   -T-T 

1  /  / 

178 

179 

180 

181 

182 

1  QQ 

184 

185 

1  «£ 

1    KS\*S 

187 

1   \_*   * 

FY   71 

190 

191 

one 

199 

206 

76 

195 

164 

118 

206 

Total 

367 

369 

385 

379 

387 

382 

259 

379 

349 

304 

393 

FY   70 

188 

188 

188 

188 

188 

188 

188 

188 

888 

188 

188 

FY   71 

143 

160 

184 

153 

206 

151 

186 

120 

157 

206 

206 

Total 

331 

348 

372 

341 

394 

339 

374 

308 

345 

394 

394 

FY   70 

188 

188 

188 

188 

188 

188 

188 

188 

188 

188 

188 

FY   71 

156 

206 

155 

169 

206 

187 

206 

205 

196 

163 

182 

Total 

344 

394 

343 

357 

394 

375 

394 

393 

384 

35! 

370 

FY  70 

188 

188 

188 

188 

188 

188 

188 

188 

188 

188 

188 

FY   71 

185 

206 

206 

141 

85 

110 

206 

97 

36 

179 

3 

Total 

373 

394 

394 

329 

273 

298* 

394 

265 

224 

367 

191 

FY  70 

188 

188 

FY  71 

206 

206 

Total 

394 

394 
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xr  =  341.507 


For  values  of  r  greater  then  30,  the  quantity  V  2xr       may  be  taken  to  be 
distributed  normally  about  the  mean,     \/2r-l   .     Thus 


s]    2x        , — /      N(\/lr3,  1) 


or 


or 


So 


or 


2x991     ^    N(n/441,  1) 


2 
2x 

221     -  21  N(0,1) 


?(J  2x^21  -  21   >    z)  =   .05 


2x221     .  21  >     1.65 


2 

x<?21   ^    256.51 


This  specifies  the  critical  region.     Since 

2 
341.507   >    x221  =  256.51 

it  was  concluded  that  the  resulting  W  =  .77  is  substantially  significant.     This 
indicated  that  the  rankings  of  teachers  was  not  random  and  that  a  teacher's 
ranking  was  indicative,  at  least  to  a  small  extent,  of  the  way  the  voting  population 
as  a  whole  felt  about  him. 
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V.    CONCLUSIONS 

The  ballot  format  changes  discussed  in  Section  I  are  recommended.    It  is  also 
recommended  that  a  year  to  year  update  of  accumulated  balloting  statistics  be  made 
as  part  of  the  automatic  data  processing.    These  include  specifically 

1.  Tabulation  of  voter  characteristics. 

2.  Computation  of  the  mixed  exponential  parameters. 

3.  Concordance  estimates  be  determined. 

The  study  of  the  effect  on  the  scores  of  teaching  in  the  quarter  of  the  balloting 
was  inconclusive  for  the  reasons  given  in  Section  IV.    It  is  recommended  that  plans 
be  made  so  that  this  question  can  be  firmly  resolved  in  the  future. 
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APPENDIX  A 
SAMPLE  BALLOT 

SUPERINTENDENT'S  AWARD  FOR  EXCELLENCE  IN  TEACHING 


In  order  to  augment  the  existing  incentives  for  teaching  of  high  quality, 
the  Superintendent  has  established  an  award  called  the  Superintendent's  Award  for 
Excellence  in  Teaching.  The  judgments  of  those  who  have  participated  in  the  educa- 
tional processes  at  the  Naval  Postgraduate  School  are  of  primary  importance.  This 
poll  is  being  conducted  to  assess  the  collective  opinion  of  students,  faculty,  staff, 
and  selected  alumni.  After  accumulating  and  processing  the  voting  results,  the 
Selection  Committee  will  recommend  an  Awardee  to  the  Superintendent. 

In  view  of  the  many  measures  of  teaching  excellence,  there  is  no  intent 
to  fix  the  rationale  by  which  each  voter  determines  his  nominations.  However,  in 
order  to  assist  those  voters  who  desire  something  more  definite  as  a  guide  to  their 
thinking,  the  following  summary  of  some  aspects  of  teaching  excellence  is  offered  as 
worthy  of  consideration:  "The  phrase,  'excellence  in  teaching,1  refers  to  that  com- 
plex of  personal  and  professional  qualities  and  actions  on  the  part  of  the  teacher 
which  (a)  make  themselves  felt  primarily  at  the  interface  of  personal  contact  between 
student  and  teacher;  (b)  help  transmute  the  student's  encounters  with  his  subject 
matter  into  insight,  enlightenment  and  love  of  learning;  (c)  elicit  from  the  student 
responses  in  thought,  feeling  and  action  which  enhance  his  capacity  for  self  education 
and  (d)  manifest  themselves  in  an  effective  individual  style  which  authentically  re- 
flects the  teacher's  own  unique  personality,  experience,  character,  and  convictions." 

A  meaningful  selection  of  the  Award  recipient  is  heavily  dependent  upon 
the  receipt  of  nominations  from  a  large  portion  of  the  eligible  "voters".  Your 
response  is  therefore  earnestly  requested.  Please  complete  the  enclosed  ballot  in 
accordance  with  the  attached  instructions.  The  results  of  the  polling,  other  than 
the  Award  recipient,  will  be  treated  as  privileged  information. 

BALLOTING  PROCEDURE: 

Step  0.   Complete  the  information  requested  at  the  top  (Part  A)  of  the  ballot. 
These  items  are  for  purposes  of  statistical  analyses  only. 

Step  1.   On  the  list  of  eligible  faculty  (Part  C),  encircle  the  four-digit 
identification  number  at  the  left  of  all  those  with  whom  you  are 
sufficiently  acquainted  to  make  a  judgment.  Use  your  own  guidelines. 
For  purposes  of  establishing  a  valid  population  base,  it  is  important 
to  encircle  all  with  whom  you  are  acquainted.  It  is  the  judgment  of 
the  Selection  Committee  that  you  should  be  acquainted  with  at  least 
five  eligible  faculty  members  in  order  to  cast  a  meaningful  ballot. 
Accordingly,  if  you  have  circled  five  or  more  numbers  on  the  ballot, 
proceed  to  Step  2.  Otherwise,  please  return  your  ballot  as  directed 
in  Step  4. 

Step  2.   From  the  subset  of  faculty  you  have  indicated  in  Step  1,  select  from 
one  (1)  to  three  (3)  nominees.  Indicate  your  preferences  in  order 
by  placing  the  four-digit  identification  numbers  of  your  nominees 
for  first,  second  and  third  choices  in  the  appropriate  spaces  pro- 
vided in  Part  B. 

Step  3.   You  are  invited  to  furnish  a  short  statement  in  support  of  your 

primary  nomination.  Space  is  provided  for  this  at  the  end  (Part  D) 
of  the  ballot. 

Step  4.   Place  your  completed  ballot  in  the  enclosed  return  envelope,  sign 
the  envelope  and  return  within  ten  days.  Ballots  will  be  separated 
from  the  envelopes. 
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DMLLUI 


Part  A  -  Statistical    (encircle  code  at  left) 

Voter  Category 


Mil itary 

lank 

Branch  of  Service 

Curricular  Area 

01 

N 

Navy 

30 

Ops  Analysis 

02 

M 

Marine  Corps 

31 

Aero  Eng 

03 

A 

Army 

32 

Elec  &  Comm  Eng 

04 

C 

Coast  Guard 

33 

Ordnance 

05 

L 

Air  Force 

34 

Naval  Eng 

06 

F 

Foreign 

35 

Env  Sci 

07 

36 
37 
38 
39 

Mange  &  Comptr  Sci 
Eng  Sci 
Baccalaureate 
Def  Management 

IR 
AT 
AC 
PR 


Student 
Facul  ty 
Alumnus 
Curricular  Officer 

Civil ian 


Rank  Department 

Instructor   AE  Aeronautics 

Assist  Prof  AO  Aviation  Safety 

Assoc  Prof   MN  Bus  Ad  &  Econ 

Professor    EE  Elec  Eng 

GH  Govt  &  Humanities 

MC  Mat  Sc  &  Chem 

MA  Math 

ME  Mech  Eng 

MR  Meteorology 

OC  Oceanography 

OA  Ops  Analysis 

PH  Physics 

NS  Navy  Mange  Sys  Center 
Part  B  -  Nominations  (use  the  four-digit  identification  number) 

First  choice Second  choice Third  choice 

Part  C  -  List  of  Eligible  Faculty  (all  faculty  engaged  in  teaching  in  the  academic  year  (1970-71 
except  department  chairmen  and  members  of  zhe   selection  committee) 


Aviation  Safety  Programs 

1014  Bomberger,  R.  B. 

1025  Bradbury,  C.  M. 

1036  Fletcher,  J.  L. 

1047  Wible,  L.  C. 
Department  of  Aeronautics 

1058  Ball  ,  R.  E. 

1059  Bennett,  J.  A.  J. 
1070  Biblarz,  0. 

1081  Collins,  D.  J. 

1092  Gawain,  T.  H. 

1108  Haupt,  U. 

1119  Kahr,  C.  H. 

1120  Layton,  D.  M. 

1131  Lindsey,  G.  H. 

1142  Miller,  J.  A. 

1153  Netzer,  D.  W. 

1164  Platzer,  M.  F. 

1175  Redlin,  M.  H. 

1186  Schmidt,  L.  V. 

1197  Vavra,  M.  H. 

1203  Zucker,  R.  D. 

Department  of  Business 
Administration  and  Economics 


1319  Hoverland,  H.  A.  1636 

1320  Hynes,  J.  P.  1647 
1331  Jolly,  J.  A.  1658 
1342  Kushnick,  S.  A.  1669 
1353  Lande,  R.  S.  1670 
1364  Lane,  H.  L.  1681 
1375  Lee,  M.  1692 
1386  McDonald,  J.  H.  1708 
1397  Moan,  F.  E.  1719 
1403  Noorzoy,  S.  1720 
1414  Smith,  J.  1731 
1425  Steckler,  M.  J.  1742 
1436  Vigen,  J.  W.  1753 
1447  Waibel,  R.  1764 
1458  Wegener,  W.  H.  1775 

1469  Wiskoff,  M.  F.  1786 

1470  Womer,  N.  K.  1797 

Department  of  Electrical  1803 
Engi  neering 


1214 
1225 
1236 
1247 
1258 
1269 
1270 
1281 
1292 
1308 


Carrick,  P.  M. 
Church,  W.  H. 
Cowi  e ,  J .  B . 
Darbyshire,  L. 
Eisenhardt,  P. 
Elster,  R.  S. 
Fremgen,  J.  M. 
Ganz,  J.  G. 
Githens,  W.  H. 
Grainger,  T.  L. 


1481  Adler,  R.  W. 

1492  Badger,  R. 

1508  Bauer,  W.  M. 

1519  Baycura,  0.  M. 

1520  Borst,  F.  W.,  Jr. 
1531  Bouldry,  J.  M. 
1542  Breida,  S. 

1553  Campbell ,  J.  D. 

1564  Chan,  S. 

1575  Chaney,  J.  G. 

1586  Cooper,  P.  E. 

1597  Cotton,  M.  L. 

1603  De  Laura,  R.  D. 

1614  Demetry,  J.  S. 

1625  Ewing,  G.  D. 


Gardner,  E.  M. 
Geist,  J.  M. 
Gerba,  A. ,  Jr. 
Houston,  R.  K. 
Kirk,  D.  E. 
Klamm,  C.  F. ,  Jr. 
Marmont,  G.  H. 
Miller',  R.  L. 
Murray,  R.  P. 
Myers,  G.  A. 
Myers,  H.  L. 
Oler,  C.  B. 
Panholzer,  R. 
Rahe,  G.  A. 
Rothauge,  C.  H. 
Sackman,  G.  L. 
Sheingold,  A. 
Smith,  W.  C. 
Spaugy,  D.  A. 
Stentz,  D.  A. 
Strum,  R.  D. 
Terman,  F.  W. 
Thaler,  G.  J. 
Titus,  H.  A. 
Turner,  J 
Ward,  J.  R. 
Wilcox,  M.  L. 


B.,  Jr. 


-1814 
1825 
1836 
1847 
1858 
1869 
1870 
1881 
1892 

Department  of  Government  2190 

and  Humanities         „„, 
2206 

1908  Alexander,  W.  P. 

1919  Amos,  J.  W.,  II 
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